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geared to determining- break-points f or ^l<5w-pass filters that would ' 
allow adequate flying control performance and provide an acceptable 
display. One experiment represented a factorial combination of 
settings of the display filters and the non-visual cues of aircraft: 
-motion provided by the g-seat and* motion platform, and the second 
represented a simple comparison of filter settings. Both studies 
indicated that, at least for formation flight, there is a ra'nge* of 
filter settings which- will not advefsely affect flight control an d" 
Mill adequately suppress visu^al flutter. This range represents - 
half-power settings for the filters of three^f ourths to one Hertz .• 
(Autbor/CK7) ' " , ' ' 
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; preface" ' '\ 

This is' the first of a series of cooperative "interactions in wbiich tjie ^ 
Naval Training Equipment Center and the A1r Force Hum^n Resources Laboratory 
can share their resources for research on the development and use of Simula- 
iri on-'devi ces and- trai ni ng systems . .In, thi s study, -the unique capabnl i ties ^X,. 
The Advanced l?Sulator fSr- Pilot Training (ASPT) at Williams Air Force Base 
were used to address a problem of interest to both, the Air Fo^^^ and the Navy, 
namely the means of extending simulation^based training to .^^^^ dnff icul t-to 
fly tasks for which, to date, devices equipped wit^mputer image generation 
FyWs have not bein used, 'several of the capabilities of the ASPT were used 
in'w^ys that make this study unique.. For instance,- this the f rst study 
concerning the problems of formation flight perfonned 6n the ASPT, or for that 
matter on any device equipped with a computer generated visual scene; it is 
probably the first use-of instructor-pilot observers In a" !:epeater cockpit , 
-and this is the first time that .it has been possible to collect frequency- 
domain summary information in real-time using the ASPT. 

> • ' ■ ■ • , 

The efforts of many people made the study possible.' Captain Oah F. 
Cataneo, Airman Randy G. Cline.,- and Thomas. R. Farnan,^all of the Jir Force 
Human Resources Laboratory, and Robert -A Greenland oJSinS^]::^;"^ served as 
simulator operators at the contriDl console; Major Myers. Captain R. C. . 
Brenneman, Captain J. G. Dunbar, ajid Captain B. D., Ott of the |7th Flying. _ 
Training Squffdrbo served as subjects in the first experiment; and Major S. P. 
Hannan. Jr.. Major J. G. Paulsen. Jr.., Captain E. B. W. Cbun.. and Captain 
J. W, Penland of the Air Force -Human Resources Laboratory were the. subjects in 
the .second one. . _ 4 ^ - . • . 

^For success.' cooperative' research require^ 
details, both before and..after the data are collected. Captain WiJl^^'P ^ 
Mercer, the CHief of Nava^'Education -a^nd Training Liaison Officer at Wil lams 
•Air Force Base energeticafly provid^d^ such attention and was an invaluable 
help, for which we thank him. - ' 



Also, a number of people helped by proofreading J^^^ report. They are- 
Walter s! Chambers /Stanley C. Collyer. Paul E. Van Hemel. Elizabeth C.,,W. 
Ritard. and Dennis =C. Wightman.' ' - - . ^ , 
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SECTION I 
INTRODUCTION 



A flight simulator is a complicated set of systems that' can sepse pil6t 
control inputs,- calculate a given aircraft's responses to them, and then pre- 

ent thi s inf ormati on- to the pi 1 ot . - Duri ng real -f 14 ght, -i nformatTon . about 

!he state of thV aircraft comes from severaj sources so that, to a cockpit - 
with its instruments and controls, today's simulators have attached a variety 
of cue-providing subsystems that form an interface for the hum^ controller 
of the device. Their task is to provide visual, auditory, or proprioceptive 
signals which pilots can learn to use to control the flight of their aircrart. 
During the past 20 years, we have se^n a dramatic increase of the number and- 
complexity of these attachments paralleling the development 6f more sophisti- 
cated weapons systems that are used with more complicated y£>ics. visual 
display "systems, for example, have evolved from prerecorded films that allowed 
little freedom for simulated flight, to model board representations of the 
visual world that are presented to the pilot via a movable television camera, • 
to the present computer image genei^ation (CIG) visual display systems that 
allow limitless maneuvering by presenting visual scenes that are stored and 
changed by digital computer. The te^chniques for providing other cues for air- 
craft motion andjof simulaiinQ an as/sortment of sensors have undergone a 
similar progression o,r^velopment, ' and even the training systems that use 
flight simulators are\^becoming automated. 

Modern fliiht simul ators' use digitat c^)ntrollers, and each of .the devel op- 
ments-cited above has placed a burden., on the computational capacity of a 
devfice's computer. For the most part, digital computers perform calculations 
ser*^^a31y, with additional calculations requiring additional time. The Clfa 
display processing adds perhaps the greatest numberVof calculations to those 
needed to operate the basic flight simulator,- WhenlOGvisual _sys terns were 
' used on Navy Device 2F90 and the Air Force^^anc^d Si^wl ator- f or Pi'ot 
Training (ASPT), problems of control 1 abil itycSrrs^ by thfe addition of this 
type of display became apparent (O'Conner, Shinn, and Bi^6ker,>.l 973; I-a':son 
and Terry, 1975). These problems of device control were usually seen, during 
■ the simulation of flying situations where the aircraft had to be flown within, 
quite narrow tolerances, such as on the last leg of a carrier approach or 
during formation flight. - 

A temporal gap between input and output is expected in systems that use 
-digital processors as controllers. The simulator's computer must sample the- 
inputs to the system and then calculate its responses, and in the case of a 
. .CIG visual -system, a second computer usually controls the displaying of those 
. responses. For a flight simulator equipped wi£h a CIG ,d-isplay, Jhisdelay of 
vi-^ual feedback can be broken into two -parts ~ that related to the ^mpl ing 
sra^e of the flight dynamics processor and that due to the processing tirne of 
trte visual display system. Current' flight simulators sample pilot activity ^ 
at 15 to 30 Hz so that the time i nterval - f rom the calculation of one set of 
positions for the simulated aircraft until the next is rarely greater than 
66!6-millisecond%, and the cal<:ul ations .needed to create each true-perspective 
. im^qe take about 100 milliseconds. The actual total transport delay may be 
l^i thtn the sum of these two values, depending upon when within the computa- 
tion cycle the, values for the, aircraft's new J" are passed to CIG 
system. In the ASPT, these two computers operate ^at different sampling ra.tes. 
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ith the result that the total transport delay for its visual scene varies 
»tween 126' to 193 milliseconds (Larson and Terry, 1975). Other cueing 
v-ivlces of a flight simulator, such as model board visual systems, motion 
platforms, or g-seats, produce lags due to the inertias of their mechanical 
components and can produce delays a good deal longer than those of the 
computer-generated visual displays. 

One of the most difficult tasks to simulate in a device equipped with a 
N CI6 visual system is formation flight. Unlike most flying tasks, for-nation 

flight closely approximates pursuit tracking in that an image of a lead air- 
^-'craft-is-<lis{>layed-to^ p^i loV a»d he has .knowledge, of . where Jie should^^^^^^^ — 
\ relation -to that craft. One might then expect that* with its visual refer- 
ence, formation flfght would be easier than ground-control led approac 3S or 
instrument landings that /more, closely approximate compensatory track- ng; but 
pilots do make rather h^gh frequency control movements — up to 3 Hz ..yrus, 
1976) — during formation flight and we feel it is this tendency, along ... 
the phase lag produced by delays in the system, that makes flying formation so 
difficult in simulators with delays. The phase lag produced by a transport 
delay is linear with frequency, causing the high frequency components of con--- 
trol inputs to be more out afT phase than the low frequency ones. When facing 
such a situation, the tendency of human controllers is to force the system 
to a lower gain-crossover f:-sr;^3ncy by trading response frequency for ampli- 
tude. In a sense, it is th-t t-- .c's willingness to. tolerate high-frequency 
error that enables him to kec^. cne' system ^stable, yet the requirartents of 
flying formation are such that displayed errors must be reacted to quickly 
and kept small. From descriptions of- tte operation of flight simulators with 
CIG visual display systems, it appears that flying tasks with those require- 
ments of accurate control of the aircraft and quick response to error are most 
affected by display delays. This is -supported by disciJssionS of the experi- 
mental literature of manual control of systems with delays (Muckler and 
Oberraayer, 1954; Poulton, T974; and Ricard and Puig. 1977). , . 

Past attempts to compensate for dead-time delays in simulation systems 
have for the most part, been concerned with reducing t'^ response lags of 
motion platforms."^' At the National Aeronautics anc Space Administration 
Langley Research Center, Parrish, Dieudonne, Martin, and^Copeland (1973) used, 
a linear^ projection of a simulated aircraft's rotational axes positions to 
adjust the signal-s sent to the motion platform of their d^ce. Later a fil- 
ter with a "notch" centered at 32 Hz was added to remove vibration caused by 
the 32^ iteration" rate of the device's processor. Motion platforms respond 
si owW compared to the abil ity, of a compu-^s. -driven visual display, and when 
the ^me technique for compensafin'g for delays is applied to the software 

that-creates the signals for a CIG visual system, .the displayed image can con- 
, tairi an annoying "jitter^o'^ "flutter." Th-ii happens because the linear pro- 
jection scheme 'amplifies: the high -'requency compcnents of the signals senf to 
the display. More accfurate preUtction would produce less jitter, but some 
would occur whenever pilctsmake high frequency control inputs. One would 
think that "software schemes that provide a phase-advance for the pilot would 
help his control of systems' with delays; and indeed some work at the Naval 
Training Equipment Cemrer has indicated tha ^ fgl'.owing a linear projection 
scheme with a low-pass filter (which allows_ytow frequency phase-advance 
while attenuating high frequency jitter) would help piloting control a'nd . 
- would potentiate the acquisition of control skill (Ricard, Norman, and 

' V - 

.8 
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Collver 1976). The main purpose of this study is tp test further the use- 
fSlnS^of the predict-then.filter notion by observing trained pilots asked 
to fly formation in the ASPT. . , ' 

Figure V should provide a\on text for our changed to the computer soft- 
ware Each of tK-e cue-providing subsystens of a simulator has as its input 

mJ^s in the flight dynamics l^hose S^d^lted vXes 

to the CIG display system. ^ ' , 

A second goalVf the study was to assess the usefulness of the pi^prio^ 
cept?vrcSe?n'g prodded by the 5-seat and^motnon pl^atfom Few^^ 
data exist concerning the.advantages offered by these systems wne 
scene is a computer-generated one and the flynng task ns^d.f^ 
partly because CIG displays are ^ new -cecnnaiuyjr formation 
and partly because attempts to use CIG fjP^yf,J°riJ^Ccause the delay comi- 

riave shown some benefit ga ned by adding the P'^°^' el^eral ly they found 
nidtion base, at least for ^? ^°XS%?y! Ih^^ho^^^^ the'^delay 

that the more difficult a simulation was^OTiy.^ne :^^ rt>otion platform 



.t 
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Figure 1. The cuer-provi ding subsys terns ^of a Bwdecn flight simulator 
■ (Arrows indicate the direction of. the :f 1 ow of Information) 
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, -EXPERIMENT I ' ' 



.METHOD 
SUBJECTS. 



The four volunteSs" «ho se^ved^asJ'ub3^ 
Air Force. ins-trOctor pilots "-.g^^^-^^f ^^e irstructo?s for^an?ed jet 
at Williams Air Force Base, Arizona^ ^linmnl^tpd between 1200 and 4200 < 
tr^inJng' in the T-38 aircraft ^^id -had accumulated betw^^ ^^^^ 
indivf dual. hour? of flying time with a group average or over <. 

EQUIPMENT.' This study used the ASPT . ^^^^ jrt^iniSCl'ftSfcfc'kp^^^^^ ^ 
> located ^at Williams Air For.ce Base, J'S^S^y^jf ^ ^^^^^ the mbtion 

witfi- Systems Engineering Laboratories Model 8^ ^^^^nz^^ ^ 

bases-.. g-seats, and computer-driven visual displays to^^ 
instructor/operator console u sed^f or controlling ex 

board-entered codes and for monitoring J^e prog^es.s oj^If^^^g aircraft - a • 
The -simulator cockpits were configured Jo^^^jr^^^^J^^I^-^ZS' ees-of-freedom 
two-seat jet trainer J^ey^were mounted on s^^ 

^S^^ies^rrt ^llftTX rhl^??frl?t?s Vertical, lateral, and 
jongitudinal accelerations and of y/second^^^^^^ ^ . 

^^^^T;^^^^^ Pilot's g-seat and 

by varying the tension on his seatbelt. - 

Th. Simulator's CIG syst^ P:?^^"^^^>i3^:?yl?r'rirr^^^^^^^ 
cathode ray tubes and display optics equipped^w^^^ ""EaSl^ckp fls p^ially 

Tu??omra^?ro1 re^^roTrsllei^tronlshled display channels. . 
that provided a 300? horizontal .^1-50° vertical fi el d-of-v^^ 
duplicated the field-of-view of the T-37 aircraft, at^^^ present 
thorough- the Pancake window op^ ,P to,. . 

the computer-generated visual scenes wiw is capable of displaying, 

six foot lamberts. The entire_ visual aispi ay ^ ^ cockpits.. 

2500 edges and of allocating them over ^^J^^^l^l^^^to each cockpit so that 
In this study, ident cal visuals scenes v«re presenwa to ea^^ ;^^ ^ 
each seven-tube mosaic was assigned l.OOq edges jo^ of 500 

Ts? ircraft in the position of f^^^^^^ 

•edges was retained as a b"J^er to b.e ^^Iggd from one channel to . 

occasionally. wherTparts o^.^hf. ^^ad be exceeded and parts 

another, the edge-handling ^^^^^ ^^^J^^J^l!^ the d^ Priorities were 

■ rect relative positions, tti^e conflicts did not arise.. 
^ The advanced^nstructor/operator ""sol^ TKjbla^d^'lw'slve;-. 
'S\lr..f^\m'lT.%^lT<^^^^^^ unSli:- p„,;a» control , . 
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three closedAcirpuit televise channel's, a contro.l stick, pl^us a number of 
Pitches- an ^a^^fs. Codes for .the conditions of -the experiment and commands 
to 'feontinue^^SlJort a trial were entered witfi -the keyboard, 'aad the results 
were .verified- over the co«>r alphanumeric displays. The afchroTnatic displays 
were used to" present information concerning the state of the two aircraft,; 
Including a graphics representation of relative positions. One of the 

closed-circuit television "cha^ftfiels" was */sed to view the -pilot in the cockpit, 
and* the other two were used t6*di splay" selectable chani^el s of His, computer- j , 
^'generated visual scene. " / ' . 

qASK. vThe flying task "used Vor'this 'Study was to maintain the- "fingertip" 
P05>tit)n off the ri^ht wing of a lead •aircraft (a T-37). -This is a-visually 

guided -task that_ requires the pilot to hold' apposition 30° back from the r-'^ 
lead aircraft while maintaining a. three-foot- wing tip clearance.' When this 
position is obtained,- the lead aircraft appears as^in Figure 2. {copied from 
Air Training Manual 51-4)' which is a fair representation of the high fidelity 
image of the lead aircraft used by the ASPT. Several of the visual references 
thaf pilots are traine'H' to use to hold the fingertip position have been indi- 
cated in the figure: (1) the lead pilot's head is kept aligned with the out- 
side flaptiinge and the radio antenna of the lead aircraft, (2) the top 1/3. 
and bottom 2/3 of the lead aircraft's right wing are visible, (3) the trailing 
edge of the lead aircraft's opposite elevator is barely visible,\ as is (4) the 
top part of an inverted triangular ejection warning sig^ located on the fuse- 
lage "of the lead aircraft just forward of the pilot. Poj^^traight-and-level 
intght, the fingertip position can -be maintained with a constant throttle 
setting and small movements of the control stick, but during maneuvers like 
turns, throttle changes must be^made in order to~maintain the pQSation. 



0— 




Figure t. 



Pilots' view of the T-37 aircraft In the lead position when , 
flying the finger-tip -position oVf its right wing (Taken from 
ATCM 51-4). . • 



^VfTRAEQUIPCEN IH-297/AfHRLrTR-78-46 



EXPE^^IMENTAL D'ESISN. Our intention was to examine the effect of select! velV 
filtering the drive signals sent to the CI6 system processor and the effects 
sucPfiUeriM might have on a pilot's use of the ntJnvisual cues of aircraft i 
mS^?oraJ!^tSle fn -mo.dern fligKt sirnulators To that^^^^^^ 
tion was designed as a. three-factor, inl xed -effects factorial ew^^ 
.differences due to subjects were considered ^ random affect and the eff^^ , 
pfdduce^d by.the types of motion, cueing and settings of the tlTsplayjlSi!^'' - 
fnteS were considered fi^ed. Three conditions of motion cueing were 
^;{^|gd -I corresponding to the presentation of ju%t the visual scene, or , 
to the addition of the proprioceptive cues provided by e ther 9-seat or 
the motion platform of the ASPT. Six settings for the signal fi ters v^^^ 
^included; these represented half-power points for th^ low P^ss filters of 1/^. 
'J^2 3mI 1, and 2 Hz, and an unfiltered condition. Thus was fomed a -three- , 
f^s>x-factoriaVwhosl 18 combinations or motion and filter conditions were , 
bT^ck randomized with a different hrder of presentation for each subject. - 
Sch s^bJeS co^pl^^ three of tfese IS.trial blocks during the experiment.. 

. ' Despite the fact that oSr subjects were expert instructor pilots, they . 
experienced considerable difficulty in adjusting tfi.the <:t«i^icteristics of . 
thrsimulator. This was partly because the presence of the transport delay . 
Sde ihe fSJ^ation flying task difficult, partTy because the computer system 

^ Si led several times during the first day or two of t^e experiment, and 
Partly because the pilots were not accustmned .to the math model sjor certein 
Ste^f of tL d'evice, particularly throne that calculated changes |f 
airspeed in response to small, quick changes of the throttles, /o^^ tnis ^ ^ 
reason we expected performance to improve throughout the experiment and our 
Stl?ses of v^ia^ce^-nclu^ed a "trials" effect to remove this variability 
from the error terms. .■ j - > 

A secondary objective, of the study was to co'"?^^. ^^tings^obt^^^^ from 
both the pilot flying a maneuver and an observer m the second cockpit. 
wHile both raters saw the visual" display of the lead aircraft, onlyj^e 
Dilot had-h^s q-seat or motion base activated, so that comparison of the ^ 
m- o^s- and oblervlrs- ratings would measure. the contribution that. nonv is ual 
?ies of mStion had on the pilots' judgments of the adequacy of. a simulated 
- ^%hV For ihese comparisons, we used the s.ame analysis-of-variance model 
mln??nnoH parlfpr These rating data were collected as the^experiment 
Trogressed'Ini ?o; tJ^ p?lo?s at least, they fit the b1ock-'f%ndomized design. 

- . /: • 

EXPERIMENTAL VARIABLES. 

Filter Settinqs Previous work (Kicard," Norman, and Collyer, 1 976; and tests 
al the If r K?ce Humn Resources Laboratory) has established that °Ptimal 
Sttina for t>ie filters for the CIG display signals would be- tn the^range 1/2 
lo T hI so fS? th rtest 'of the utility «of the signal filtering notion, a 
single-Jole Butterworth filter (see Stems, 1975,or ©ppenheim and Shafer, 
1975 routine was developed. To be consistent with previous 'work performed 
1? the NaJll T?lining Equipment Center, we-used a fi^st-order, low.pass filter 
Sth the B2tterS6?th configuration selected for its smooth ampli^de. and phase 
ricDonsI onirthree degrees-of-freedom of the simulated ^aircraft were fil- 
• ter^3"!!VolVanglefpiteh angle, and z-axis - because the P^l?"""!;;^/"^^- 
^ Sif of other wofk perfonned at the Air Force Human Resources Labor.atory • 
^i^us, 1976) indicated that only the responses along these axes contemed 
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enough high. fre<juency energy to creal^ problems of J'fl.utter" inT the j/isu^l ^ 
dispUy, .When the filter rout^e- was integrated j"n to the -frSPTVs softwareijt- 
was placed after the visifal prediction algorithm {seeaarson and Tei^rV-, 19/5 
and -it therefore affected on^y the vi suaV display, not ^tlier aspects bf tHe 
simulated flight dynamics. All trans! at idnal and ;ratationa.l variables were 
time-adousted^for the transport delay in tbe*ASPT CIG visual system, then-. , -< 
those mentionai; were f il tered , and final ly 'ill, were processed by the^CIG 
system. . Specifically, each variable'was^-piredicted according to the /foil owing:, 

x^+l = x^^ + h/gCSx^^+i - Xti) where x "»s the variable bei-n^ adjusted » itsv^- 
derivative, the subscript refers to a -value at a point in time, ind h. is the 
integ^tion interval. To accormodate different iteration rates for the apro- * 
cessing of the flight dynamics and the visual image, the -prediction: span-h- is 
variable in the ASPT. We deemed it premature to try to. select individual _ r 
settings for the filter for each axis,, so for thi-s test, .the three aircraft 
parameters that were adjusted were pass.ed through iderttical filters. The 
method developed to accomplish the inte'gratitjn and filtering for these axes 
has been presented by Cyrus (1977) as'ik g^nejral technique for compensaJiTig, 
CIG system transport delays. Its advantages are that rthe-calcul.ations it . 
requires can be performed simply ^hd qyickly, and it wbuld be easy to^mple- 
ment either in hardware or software.' The technique does require that pon- 
stants be set that may be a functibn of the type of ^^lying task being ^simu-: 
lated, hence the n^d for studies like this one. . . 

In evolving this approach to' compensation for transpoft^delays in -visual 
display systems, we" assumed that the' information used' by t!:te.-pilot for con- 
trolling the aircraft and the noise generated by software pt^ictiqn schemes 
are different functions of frequency. More specifically, we assumed -that both 
are monotonic functions somewhat similar to those depicted in Figure 3, in 
that most of the useful information in the signal is low frequaicy and that 
the more annoying noise is. high frequency. The manipulation of the break j 
frequencies of the signal filters, then, is an empirical attempt to find the 
-signal-to-noise crossover point of Figure 3. By setting the break frequency 
V the filters there and. removing the high -frequency components from- the • 
signals sent ta the CIG display processor, we should be ab-le to improvejthe 
"quality" of the visual information presented to the pilot, and presumably, 
his flying performance Silso. ' t> ' 

Mo tion Cues . Because the two aircraft were in their -correct positions at the 
start ot a trial and because we used instructor pilots for the formation _ 
flying^ task, we expected that our^ subjects would have to produce .only small 
changes- of piloting. control and aircraft state parameters in order .to control, 
the simulator, and that^such a siJuatTon would enhance^^e .usef4ilnes\.of- those 
subsystems of flight simulators -fiat provide nonvisual .cues of aircraft ■ _ 
motion. If a trial was flown well and the si^nulated aireraff was kept tti "its 
proper fingertip position, the expec-fced motions of the ccickpit would be small . 
and the relative scaling of the signals sent tq the actuators,, while normally 
' less tfian unity so that- effective cueing can be -provided, for large g-.forces, 
could for this te^t be set one-for-one. To that end, rthe^mathematical model 
for the signals sent to the motion platform was. ;x?hanged. The- ' gravity al„ign 
subroutine — which keeps the resultant simulated external force vector 
aligned with the normal earth vector .— was kept active, -but no additional 
cues for the translational motions of the aircraft Were provided. Together 
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irfa< indi&iteci by the abintv of Tnstructar- pi 101:5. dsa-iyncu ^ n,.- ■■ 
'ISL; R^&uSeruto^^^ the direction .of small- 

(<1C^) oTatform inclinations and by their agreement that indeed the motion 
ffirS waf^rceived- to move before the'CIG visual ?^.S"4S AS^^ 

kmall 'control inputs were entered from the cockpit. Details aboyt the /VSPT/ 
motion- system-, are provided by \|(ron (1975*). ; , 

To increase the ability of "the ;g-seat to 'act f^signaling device.^ 
software was chanqed to provide a nonlinear signal for^the position-toi owing 
bellows s^lleS- This^s accomplished by creating as the fo^^"g ^"f.tion 
f nr the bellows, a weighted average of aircraft velocity and acceleration ^ 
Values! lie'mSunt'^f'lead which'thfe.g-seat could be^provided was thus con- 
trollable, and for this study was subjectively set. As in the case^oT tne 
aSjus^ents ?o the action of the simulator's motion: syst^. the cues o^^ 
rotational motion were considered to be.more important than those of transla 
tional motion. Kron (1975b) has also described the g- seat of the ASPT. . 
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Hypothesized relation of Information useful 
for flight control and prediction scheme noise 
In the- computer-generated image as a function 
of signaV frequency. , 



IH-297/AFHRL-TR-7&-45 ' 

PERFORMANCE ^lEASUREWENT. We" collected two tyfJes 'bf data: pbject^^7& measuresx 
of the pilot's perTormanGe of the. fly?ng' maneuver, and jSubjective impressiorrs. 
both of his. performance: and. of the^ Jitter of the ClG'dispVay. The latter 
measurfe^ were ratings collected from both thfe pi lot .-and an observer after 
each tri aU • "-For the 'fom^tion flyi^^ task,' the objective data'-^ncTl uded 
measures" of the trans! atioharl '.motions of the 'aircraft (x-,-y-,-4|nd z^axis 
errors measured as -differencies' ,cff ^position or the^ two aircraft^, measures 'i. 
.of its fbtatlcmftl motidh (piSftihj fol^^,. and yaw angles ,;^again measured 'as'. 
-differences), and measures 'o*€:the positVJ'n o^f the aileron and^^elevator con^ 
trol\35tick, and tise positions of the rudder pedals and of the Ter| and right 
throttTes.- ,The measures of the/ lag aircraft's absolute positioi>«^rr space 
were obtained relative tor the positioji 'pf the, lead aircraft; 'Co^adjust them, 
to be errors from the ideal position for the-lag craft, the following con- 
stants should be added: x-axis = -21.25 feet, y-axis-*^ 35.78 feet, and z-axts 
.-'3.00 feet. After the' first 20 seconds oV a trial,. these eleven parameters 
were .sampled 15 times per Second and recorded ^for 137 secqrids. The perform- 
ance measurement routine devel oped for thf;s study obtained .both tTfae-history 
and frequency-domain suiraary in-formati^n for these eleven variablesV These 
summaries represent linear transformations of the information contairied .in 
the time histories, and for each parameter sampled, we calculated its mean 
and variance. Each variable was also passisd through five single-pole 
Butterworth filters with half-power points of 1/8, 1/4, 1/2, 1, and 2 Hz to 
dbtain a crude estimate of its power spec traT density function. At the ^nd 
of the day's testing, all of these records were stored on magnetic tapd along 
with the information needed to identify" each pilot, trial, and factor combi- 
nation. . - ■ - 

Ratings., provided the subjective assessments of the flights and of . the CIG 
System's vfsual scene. At the end of each' tri"a'i , both the pilot and the ob- 
server were asked to rate the 'flight using the scales' presented in Tables A-1, 
A-2, and A-3 of Appendix A. One rating, using a 12-pdint ntimerical scale, 
was used 1:o nndicate how well the lag aircraft appeared to maintain the 
fingertip position, and another rating, a nine-point letter scale, was 'used ' 
to appraise the "usefulness" of the CIG visual scene." i he" i nformati on needed 
to make the numeric ratings was presented on each instructor pilot's score 
sheet (Table A-4 o'f Appendix. A) so that, as an example,, a flight- rated "good" 
would receive scores of 7, 8, or-~9 whj'rCh would represent a flight where the 
lag aircraft was held' approximately not more than^-2 feet high, 4 feet low, 
3 feet forward or backward, 1 foot to the left,- and 5 feet to the right of 
the ideal position. These criteria were developed through discussions with 
instructor pilots at. Williams Air Force. Base and after considering the 
geometry of flying formation — i.e., moving the' lag ojpward and to the left, . 
for example, would be much more hazardous than moving it downward and to the 
right. The other ratings, recorded as letters to avoid confusion , with the 
numeric scale, were a bit more loosely defined. They were included to.^assess 
the annoyingness of the,')"f l«?4ter" in the CIG s^jstem's visual display. 'Init- 
ially the "instructor pilots wsre ignorant of the purpose of varying the 
settings of the display signal filters, but after the first 18 trials, they 
were informed that it was the visual flutter that we were trying to remove 
.from the display and they, were requested to direct^eir ratings to that 
aspect of the visual scene. \ * 
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•PROCEDURE. Several ^events took place beforejthe -exper.inier^i^ One 
of these was^tio make fTightpaths for ittie^Te^ aircraft vrithjwhich the •^nstruc-' 
^ tor -bilots-cbuld fly formation. The inatri^tor's console, bf- training simula- 
tors is often 'equipped with a. control J^ick which can be'-used to. change the 
: position of the pilot's aircraft or ^to "fly" the ifiiage- displayed to hi^--^^ 
Usually there is- no throttle for this control>and the aerodynamic model that • 
generates -responses to inputs from the instructor' s station is^simpler than . 
the one,Ahk responds to .inputs fr^m the cockpit of the sirnul^tor. Because, . 
the ASPT is equipped with tvKv..cockpits,^ach with its own CIG vtsual display 
mosaic, we decfded to prerecord f Lights for the lead aircraft- and thus be 
able to. use both cockpits for real-time data collection. An instructor pilot 
assigned to the, Human Resources Laboratory flew, a number of ^flights during 
which he performed gentle climbs, dives, and turns. These ''^^"•Shts were re- 
corded and then used to drive the CIG visual system to create the flig^tpath 
for the lead aircraft Tor our formation flying task. During the data/collec- 
tion, the prerecorded' flight controlled the image of the pilot s yie^ of the 
lead craft-for both cockpfts. In this way, the lead aircraft could be made - 
r to fly realistically while freeing the second- cockpit for an observer. Twelve 
^ such flights^were recorded, and from this set, six were chosen f^ use^during 
the experiment?" Two criteria were used for thjeir selection: fir^t, that the 
instructor pilots assigned to Air' Force Human Resources Laboratory^ judged 
that the particular flightpath was -not too difficult for formation- fTig^ 
and second, that the .selected flights presented fewer synchronizationr p¥5blems 
than the rejected one\. If a trial was Itarted at an inopportune time, the^ 
calculation of the position for the lead aircraft was begun ^^foi^ that for_ 
the lag aircraft and the CIG system's image "jumped" ahead. It was fo^ this 
reason that a 20-second dead- time was included at the start of each tri£. ^ 
It gave the subjects time to catch-up to the lead aircraft before data^r| 
"recorded. Some o'f the prerecorded flights seemed to magnify this syn(5hTOni- 
zation problem, andthese were the ones we deleted. The advantage gained by 
usinq prerecorded flights was the improved dynamic response of the lead air-^ 
craft which the better math model allowed.* However, a simulator with two. 
"active" cockpits has a disadvantage. The effective delay from control input 
in one cockpit to display and then response from the other cockpit wou.ld now 
be doubled. A 100 to 200 millisecond visual, system transport delay becongs 
a 200 to 400 millfisecond total system delay, and the problems of PTloting^ 
control are made even more difficult.. We might note that this was not the 
case in this study as. only the pilot's cockpit could provide inputs to the 
CIG visual system. 

Personnel at the Air Force Human Resources Laboratory also performed the 
tasks of software integration, i.e., of developing and Inserting into* the 
simulation program the filtering and performance measuring, routines, and 
of setting the lead times and gains for the g-seat an^^^'I'oti on platform _of 
the ASPT. They also developed the rating scales specifically for the forma- 
tion flying task and created the >lock randomized orders -of experimental . co^^ 
ditibns fo? each pilot. This las^ tas^ was performed ^n a Wang computer at 
• the Human Resources Laboratory using RPograms developed there. - 

Prior to the collection of data, the instructor^ pilots^re^briefed about 
the nature of the experiment and of what would be r&qurred of them, and on ' 
normal operating and safety procedures for the ASPT. Along with viewing a 
-safety film! th^^^ had an opportunity to "fly" the ASPT for a while to see how 
it operated. • ' 
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-The exireriment 'cons.isted of ten fBur-^npur testing sessions with two-fn- , 
• stnictor pilots present each session. Each served as pilot and then observer 
fo?^2Sut half of each session, .with each serving as observer for every other 
at least twice during- the f.ive days ,of testing. Initially we h^d ^^oped Jo . - / 
. Snplete one baock'of 18 trials per day. but this proved to be overfly optimis-. 

^so that oijly three such blocks were finished* by the ^nd 6f the data_ cpT-^-. r 
■ l^rtiSn! It^th^ beginning- of a tesfin^ 

'see tM-t it was set appropri-4tely for this expemMt.. and ^h^' ^^yj^^^l.^^.. . 
device was being .prepared . 'the pilot andiobserver ^^gwen their data s^^^ 
Jnd a^ked to enter the. cockpits. Radio contact was ^^^1 1 shed with 
' Dllot and..was the means of pllot-experimenterJcotrmuni cation used dur^i? or 
' -^aS te^/^ch tnial incllide4 a one-to-two minute period while exp^imental 
•••■^to^di?!?^ codes were entered at t?ie>instructor/opera4»r J°"s°le. and then 
when the operator judged rfhe pilot ready, a key P^l^ss actuated the trial pro- 
gi%un, ^starftng a Isr-second^tHal wit^' dat^ recorded^during the la|t^l37 
spronds All trials were started with the fully-fueled T-37 flying at ^n 
• li^sSeld of 190 knots li an altitude of 15,^0 ^feet. At the end of ea^h. one 
oflhfinSructor pilots assigned to the Ai?: Force Human Resources Laboratory , 
Sad-e tffel^ judgment St^ whether or not the fl.iglj.t should be considered controlled 
, SoSgh to produce reasonable data, and t hen Jihe recordings were either entered 
' into th?dlta file for this study or were^eted. Conditions under^which 
Sntrol w^ los^were repeated immediately. Trials for which the motion 

^ai!SVm had to be^ctivated took a ^f^o^^^^ '^l^^^^^^^^ rl]T^\T 
the cockpit had to be retracted and 1?he motion platform had to be raised -to 
its S^ing level. .-All of these events ^al 1 owed - an average time-per-trial of 
five to teS minutes, a time that was gradually reduced throughout the experi- 
lU^I. uSSl It wis time to switch places, the pilot ind observer remained in 
their cockpits, resting between trials. ^ _ , 

As -performance 'data were collected, they entered a disk- file that was , 
•stored Sn magnetic tape ^t the end of each day. After *the experiment was - 
loSSleted, a listing Sas made of this file, and the magnetic tape was taken to 
/ the Naval Training Equipment Center" for analysis. . 

' -. "At the end of the experiment, we discovered that a total of 13 trials Jad 
been omitted because of human errors while enter i.ng the condition codes and 
^ • tH^l numbers at the instructor console. The analysis procedure^ we used re- 
quired a complete set of data from each subject, so that each subject s 
missing information was estimated using measures of his performance under 
^mlla? conditions. For no subject was one of the 18 different experimental 
Sndi^ionrtkipped'morrtLn.o -so tha^t we always had two sets of measures 
with which to estimate the third. . 
■ - ■ ■ . •■ ^ 

RESULTS/AND 'DISCUSSION / . " ^ . ^ . - • 

to keep this discussion siilple, the details oY each analysis of variance • 
are prJSted at the end of the report and wil Vbe discussed only jeneraUy. 
: iafed on our ,»esults, it may be desirable to ^?i?e4-"J?l^^.|J^.^^^|y^ J ^° 
other fliqht simulators; so for this reason, all of the statistically 
lignificlnt effects related to the main variables of the study are presented 
' graphically for reference. - 
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OBJECTIVE MEASUREMENTS,, Tables B-l to^-lt of Appehdix B present the resii-lts 
ofahe analyses of >^ance:>eVfonnecl-pn the tneans^and ^variances o^ 
par " • - J.- 4.u_ 

of 
var 

were consiaerea a oJutR., ucv-ww i^iit — ", — j. 

^e?ng. B = settings the filters. C = trial s.jnd a block jffect reflects 



» analyses of variance-^rformed pn tne means ana 'vancirn,e:> unc ... . 
parameters we measured". .-EaS tab! e presents the analysis of the^average v^l.ue 
of tlfe -measure- and then 'the analysis of its variance. In these fables, the, 
variables we maaipuj-ated are designated by A, B,. and C and each subject s d^ta 
• '^ considered a "block." so to decode the tables: A = conditions of motion ^ 



diffeflnces^due to the pilots; For an effect significant at the-p<05 level 
of cdJIf idlnce or above, these tables give the probability of the^occurrence ^ 

pf^its F-rftib and its -proportion of the total sum of squares, n (Eta 
Squared). To provide some perspective, .n^'f or each residual variance term is . 
also given. Generally speaking, an advantage was gained structuring the 
data collection as ai blocked randomized factorial expenment^with -trials as a. 
factor. Often both the blocksV and trials effects produced significant ^ 
F-ratiosv and as we were able to remove this variance from the ^^eSi dual terms, 
the other tests were undoWedly made more sensitive-^ Several observations 
can be made. 



First, the=»eSi3uaMerror) 5^iances' of these analyses, that variance . 
which could not [be parsed into any- of the effects, were often quite large. 
Sr the averSge valEes of the measures, fo^ example, the error terms accounted 
fo^ 67 percenUt^ total sums , of squares, and for the ja:?^""!';*^^ J^-^-'^-- 
ual vari a-nces /%SSted for 59 percent Typically none of the effects we ■ - 
could anal^ze^erVstatistically significant if the residual term had an 

greater ^than 0.70. Usually those analyses of variance that produced . 
significant F-ratios had error terms fo^ which n^ was in ^^e range 0.50 to 
0.65. In only three analyses (the oneTof the variances of the positions of 
both throttles and of the mean position of the left one) were ^e^^l^to _ 
reduce the residual term to less than 50 percent of the total sum of squares, 
^ thlt obviously a good deal of the variability of our pilots* performances 
was not accounted for by the conditions of the study. — ^ 

Related to the large amount of unaccounted variance is -the presence of a 
triall effect in the analysis of man^^ of the measures. This was seen in the 
a^Iliy of th^ laraircraft's attitude (relative to the lead craft) and in 
Sll mlllurls 0? p?l'otingrcontrol . w|ile the trials effects were statistical- 
ly reliable, they were not large, wi.l^ji n values' of only 0.10 to^0.12. _ 
Usually this difference of average performance, was seen between the first set 
of 18 trials and- the-next two sets. Our instructor P^^9ts were naive to the 

■ ASPT so that an effect due to sequential testing was quite expected. It was 
included in the InaTyses, as was the blocks effect, to reduce the size of the 
Z?rortenis. Usual 1^ the effect due to progressive trials was quite relia- 
ble! with liall probabilities of ocdurring by chance,.yet |ome measures, as 

.the difference of translational position of the two aircraft did not show . ^. 
this trenb. ^ . . 

The lack of a trials effect in the analyses of th4, measures of the posi- 
tion in space of the lag aircraft leads to a third observation: that those 
measures were relativelyinsensitive to the manipulations of this study. On 
S^ly one test - that for the effect of different filter settings on the 
varfancl of the x^^axis .difference of position of the two aircraft - was a 
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Significant result obtained (^owh in Ffgure-4), and this was profciably 
spuHous. Thts was not one of the variables we filtered, and it a 7^6^ s one 
where we would expect Ijttle or na sUch effeSt to be found. Our im^essions 
during the cbllection-^f the data j^ere that the-^actual flight paths taken, by 
the lag aircraft were/a bit too variable for the^easurement of any differ- 
ences of the pilots' -ability to control the simulator, and tbe analyses of 
variance confirmed these. Havirtg , the lead aircraf^ undergo climbs; dives, 
and turns- and >equiring the pilots to mMntain their aircraft m a given 
position relative to the lead; brought to the fore^ their unfatnil iarity->nth / 
the simulation system. . , 
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Figure 4. Variance of the x-axIs difference of position of the 
lead and lag aircraft as a function of filter setting. 
In this and the subseouent figures, the — symbol represents 
the break frequency or the unfiltered condition, although 
for this simulation, the Hyqulst frequency of the ASPT 
CIG system Is 15 Hz. 
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^ Along vrith the z-axis difference. of position, we .filtered the differences 
of the aircrafts' pitch; and roll angles, and of these, the variance of =J:he 
pitch-angle measure showed an effect of this filtering. Jhe varifblT?!^ J 
the lag aircraft's pftch angle was reduced, and so .was the vanabil ig of the 
pilots' longitudinal and lateral movements of their control stick. Tha:t our 
^iipulaS of the display actually affected piloting control is comforting . 
given the adaptation to the simulation system required of the pilots. These / 
mealSres pSted as a.functic^ of the break frequency of the display signal 
filterfarrdepicted in Figures 5 and 6^ All of these functions display a _ 
reduction of variance as the break frequency of the filter "-s increased up^ 
about.3/4 to 1 Hz. For the variance of the differences of P^^ch , angle, there 
is a hint that the variance then increases under no-filtering^ond tion,^ 
although that value does not reliatO^iffer from those produce^by filtering 
in the rangrof 3/4 t^ 2 Hz. The difference is not statistically significant, ^ 
but it does hold the possibility that more sensitive measurements may find 
that the measures of aircraft attitude display a U-shaped ^ti on acr^^^^ 
filter settings. Those for the variances of the positions (^f the control _ . 
stick definitely -appear to reach an asymptote at about 1 Hz ^th no indicat on 
of f h?gh ?requenc7elevation. Our filtering ^^e display signals not_ only 
encouraaed the pilots to use the aircraft's control stick differently, but 
luS ^ef to differences \of their use of the throttles. The. |verage positions 
of the left and right throttles are presented in Figure 7. Although tne 
?igji?icfnt differences of throttle position were seen in the average values, 
not in the variance, af these positions, these functions appear similar to 
?^e il?evious ones where variances w^re reduced as the display was made more 
responsive until a filter setting of 3/4 to 1 Hz was reduced. 

Most of the-significMresults we obtained were with measurJes of the_difr 
ferences of aircraft attituBe or of pilot control inputs. J^^ majority of 
these results were effects due to differences between pilots ot blocks of 
trials, but some were relatable to the variables of the study.^^Of the ZZ 
analysis of variance performed on the means and variances of our measures. 
?ive l??ects were found to be significant but ^i^^^cul t to interpret^^^^^O^^^^^^ 
the effect of filtering on the variance of the x-axis difference of aircraft 
Josilion mentioned earlier. Another was the only effect ,^4^^°"^?^^°,?^ P 
of motion cueing produced — this was on the variance of the differences ot 
yaw aJgle. AgSinV the filtering we did should affect this',measure is not 
ctear. In addition to these- two main effects, three interactions Produced 
s qntficant F-ratios that seemed arbitrary. These were a motion cueing by 
trfaU interaction of the mean of the'roll angl.e measure, a "S^.'^^,^. 
' filter setting by trials effect seen in the variance of the differences ot yaw , 
angffr and a motion cueing by filtlr setting interaction of the variance -of ^ . 
the position of the ruddef pedals J None of these effects would have been pre- 
dicted nor are they particularly Tnterpretable. , ; . " - 
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Figure 5. Variance of the difference of pitch. angle of the lead 
and lag ali^craft S3 a function of filter setting. 
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Variance of the pilots* longitudinal and. lateral -eocis 
covements of their control stick as a function of filter 
setting. 
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Figure 7. Average position of the left and right throttles- as function 
of filter setting. - ' 



RATING MEASURES. The subjective ratings of the. flights provided fay the pilots 
and observers were analyzed in the same manner as the objective measures and 
" these results -are presented in Tables- B -12 to ,B-.15 of Appendix B. In>all four 
^ of these analyses, the blocks and trials effects vgere significant, indicating 
that the pilots and observers not only differed in their ratings, but tended . 
to give higher ratings during the last two sets^of trials. Of .the two sets 
of ratings, those based on the flights were more sensitive to the variables _ 
we manipulated in this study than were those based.,on the'noise of the visual 
image. The ratings of flight control given by the pilots are depicted in 
Figure 8, and those made by the observers in Figure '9. In these ratings, 
effects of both filter settings and conditions of motion cueihg were found. 
'For the ratings of a flight made by the pilot, there is no difference between 
the subjective impressions obtained from the visual display alone ^nd with 
the g-seat added. Both conditions displayed their highest ratings at a break 
frequency of 3/4 Hz with a slight trend toward, lower ratings a$ the display 
wa's made more responsive. The ratings for the condition with the motion . 
platform activated were on the average lower and displayed less of an effect 
of changing the- f 11 tef^setting. For the ratings of these flights made by the 
observers, similar trends^ are evident. They judged flights to be. most con- 
trolled when the pilot's g-seatwas activated and least controlled when the 
- motion platform was used. While the differences due to conditions of motion 
cueing" are significant, the ones across display filter settings were not 
significant in this set of ratings provided by the observers. , • 
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Figure 8. Pilots' ratings of their flight control as a function 

of filter setting. The parameter represents the different 
conditions of motion-cueing (V » visual display only, - 
' , - V+6 ■ visual display plus g-seat, and V+M « visual display 
plus ■otion platfoni). 
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Figure 9. Observers* ratings of flight control as a. -function of 

filter setting. The parameter Is the same as In Figure 8. 
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" \ The oiher'sets of ratings (of the noisiness of the CI6 display) were^a bit 
disappointing in- that no differences related to the variables of the stud^ 
wli« El.mrf ThP subjects were not really informed about the nature of the ^ 
D?obltnf^-i«Ir in C^G di^^^^^ and it took thOT some time to become sensi- 
tlve SiV^^^^^^^m^^^ is-r^f^ected in-the-signif^cant^^tr-iaU-a^^^ 

ef^lcts ^these data. M^st of the.cbmplaining -about flutter CIG 
uTciiai <;v«;tpms comes from people quite familiar with a particular display, 
sJ suspeirtSf somT?^^^ Sou^d' have made these ratings more useful.^ 

Bprausp some of the flying control data indicated that an optimal -filter . 

'settinq could be ?ound tSat wGuld alToW better flying control performance than- 
aTS??Uere3 Sisplay would, and because the J^t^^^s of the noisiness of the 
computer-generated image 'showed no effect of filtering ^"^^^^^^J. ^V^^.r: 
SiSSsly should be there' - we decided.to perform a second experiment to see if 

'ftiSre definitive results could be obtained. 
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• SECTION III ■ 
EXPERIMENT M • 



INTRODUCTION AND METHODS •'. . • - ■ . 

■ "The second experiment was a s-implified repetition oir the first except 
there were some changes which made this study more sensitive to the effects of 
filtering the 'signals sent to the CIG display processor. For instanct, this 
time subjects familial*^^^^^ 

for the T-37 aircraft who had between 1,000 and 4,500 hours of flying time 
with a group average of over 3,200 hours. They hiad been assigned to the Air 
Force Human Resources Laboratory to act as- advisors and subjects for experi-. - 
jnental and development work on the A5PT and had "flown" the. device under a 
.variety of conditions. 

The flying task was made easier and emphasis was placed on the problems 
caused by flutter of the visual image. Rather than have the lead .aircraft 
perform climbs and dives, the' formation fl ight software was changed to have 
the lead craf1»fly straight-and-level . To emphasize the effects of noise 
propagated forward through the visual system, the maximum buffet that the ASPT 
software could provide was added for -the' duration of each .trial. This did 
make controlling the simuTlator more difficult than just flying- it straight- 
and-leVel, but the buffet affected the translational positions of both air- 
craft similarly, -so that to this buffet, w.e added "noise" by randomly varying 
the position of the'lag aircraft's ailerons. This created differences of 
attitude of the lag aircraft relative to the lead that our pilots had to . 
correct in a compe'nsatory manner. " This noise was^ then scaled to where the - v 
instructor pilots agreed that it plus the buffet forced the formation flying 
task to be moderately difficult. ^ 

To simplify 'the/experimental ^esign^ t+ie .conditions of norivi sua! motion 
cueing used in the fdrst study were eliminated. The same filter settings as 
in Experiment 1 wer^ tested and repeated trials were used, making the data 
collection a simpTerblock-randomized -fdesign with si>^ levels of a single vari- 
able.- All six settings were tested >in each block of trials with all subjects 
receiving the same random order of "copditiohs. The testing was done within a 
s'ingle three-haur session of five six-trial blocks. * < 

Piloting control performance was measured using the software developed for 
the first experiment,- except .that we istimated an additional suimary measure. 
This was c (see .Sterns, 1975) — the standard deviation of a frequency domain 

representation of a time series. It is a measure easily accumulated in real • 
time, and is-" proportional to the bandwidth of a signal. For pilots 'control 
activities, it provides an indication of the structure of the changes that 
different settings of the display filters encourage. This time also the meas- 
ures of the. X-, y-, and z-axis position were adjusted to represent error from 
the ideal position for the lag aircraft. 



Again ratings vere used for the instructor7*'pil ots to quantify thei: 
actions to our changes of the visual display. The two scales develop© 
tA-mP' were both nine-point scales, one for the noise of the CIG system 



_ ir r^- 

ai^uiuiio w«i w.-v-.-a - . developed this 

time"were"both nine-point scales, one for the noise of the CIG system and one 
for the cbntroll ability of the simula"tibn. In constructi ng: 'these scales, . 
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attention was -g.ven^to dividing each dl^nsion into de^ 

might enable the raters to be consistent. ^Descriptions J"^ ^. a. For 

gi?en to the pilots are presented i",:[^^lf .^"^^S^^nq ?he Silots so that 
^ -this second study, more time v^s^^vailable foK brleting xne 

To remove the -pro^len, of edges being deleted during l.^^'S'^lf^^^l^Sf^I^^f 
- system was operated at. 75 percent of fu l "P|Fl*y ^Jlf ^Hhe dnls' used ' . 
ai image of the Ifead aircraft vnthout all ^;i^°':2\hat pilots use to 

each trial would also help ma'^^^^^^'^^^jf Z^il Wsl" cafe "of jitter of the 
the instructor pilots were asked to o'^serve this vvorsi: c^ ^ display during 

visual image and use it ^°^..c°'"P^:-'^°?„^°.*£?^-||??,g^ 

the rest of the trial, the pilots bri^^^ fdngitudinal axis of the 

at the altitude a.nd airspeed of ^^i^J^X lateral one and that the greatest ^ 
T-37 aircraft was more responsive than the 'ajerai one ?nu u ^ g^'in the 

Z^^^^^^^^Pf^ a^lT»is ^nto account 
as they rated the jitter of the display. 

■ attrMe-LThol^^^^^^^^^^^^^^^^^ 

• subjects and blocks Of trials to be zero a^^ j^^^ 
different settings o^^e dis pi ay ^filter s^as the only o|fe ana y^ performed 
effect was then tested with a siniple one-way analysis ot^^^^ h 

, on the subjects' average performances. The m^^ 
used in these, analyses so that ^^e ^^"^1"9S of l^f^P!^;";! ^aHabi-lity. 
average performance and do not reflect typical tri^i oy 

RESULTS AND DISCUSSION. ' 

■ 0.66^ Averaging repeated tr^2il/l=° J'^te| ,-nformatf on- about subjects' : 
device -design,- not human performance. _ - • 



ERIC ' ^ 20 , 



NAVTRAEQUIPCEN IH-297/AFHRL-TR-78-46 



OBJECTIVE ^lEASURES.- The results of this experiment can be divided into three 
categories: those most likely related to our filtering (in general.) of /the 
signals sent to the CIG system, those related to our filtering iri; the context 
of the fontiat ion- flight task, and those that seem a bit arbitrary and that 
probably are 'spurious. Effects in the first category are:changes of the,pitch 
and roll angles of the lag aircraft and the>:hanges of' pilotTng control that 
produced them. As the display was made more sensitivBlby >aising the break, 
frequency of the -filters, the pflots responded by controlling their aircraft 
so as to reduce the variance of its pitch and roll angles and to .change- the 
bahaWidth toward" Its value" for the" no-^^^ 

increase of bandwidth along the aircraft's long-itudinal axis and a slight re- 
ductipn along the lateral one.- These functions are' displayed in Figures 10 
and Il» Tfcrese changes of aircraft response- were accomplished by parallel 
changes of the pilots' use of their control stick. On both the longi tud.inal 
and lateral axes, pilots reduced the variance of "the position of the control 
stick, shown in Figure 12, and its bandwidth, shown in Figure 13. Their u^e 
of the throttles also changed as a function of the filtering break frequency. 
' paralleling the pattern of results seen in their- use of .the control stick. ^ As 
the setting of "the filter allowed more high-frequency information to the dis- 
play, Ipwer average settings forl^e throttles were used, and the variance of 
these settings was reduced. Thelfe. trends are shown in Figures 14 and 15. As 
fn Experiment 1. the variance of a measure seemed the datum most likely to be 
affected by our manipulations, a finding simil-ar to that of Cooper, Harris, • 
and Sharkey (1975). Clearly when the display was filtered strongly, so that 
it appears too sluggish, our pilots worked more to control- the simulated air- 
craft. Contrary to the data of Experiment I, there "is no indication that the 
pilots will control m6re poorly. without the filtering, than with it. T<his may 
reflect our use of pilots familiar Vith a g-iven device or merely human con- 
trollers' willingness to ignore the annoying high frequency activity in an 
unfiltered display. ' . 

Changes of aircraft position and of related piloting control that were 
placed into the second category were similar to some seen in Experiment I. 
These were the reduction of the variance of the difference of the yaw 'angle 
of the lag aircraft- presented in Figure 16, and the reduction of the variance 
of the rudder pedal position shown in Figure 17. ' Thes^ phanges probably . 
reflect the tactic the instructor pilots stated they used to fly formation 
•■ during our simulation — which was that they would "crab" into .the fingertip 
positi-oa^and then maintain a yaw angle to counter the effect of the_;iead air-^ 
craft^ s -backwash. ^ Whenever a large gust upset -the^^lag aircraft, the pilots 
response was- to move laterally' (to the right) and then- carefully maneuver 
back into position. It was probably these responses that caused significant 
effects in the variances .of the yaw angle and rudder pedal positio;is. ^ 
Another flying task, like aerial refueling or air-torground weapons delivery., 
may not show similar effects on these measures. . 

Probably related to the above technique was a tendency to. keep .the aver- 
kge position of the" control stick a bit off-center (to the right) that was; 
accentuated at low break frequencies of the display- filters. This was 
probably used to counteract the tendency of the-backwash tcr .rail the lag. 
aircraft-to the left, arid when the dtsiJlay was sluggish (relatively), the 
instructor pilots were conservative and tended. to keep their craft prepared 
to roll to the right. This u^e of the control stick is documented in Figure... 
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Filter Break Frequency in Hz 

, . ■ ■ ' ^ 

Figure 10. Variance of the difference of pitch and roll angle of 
the lead and lag aircraft as a function of filter 
setting. 




Figure 11 . Bandwidth of trie pitch roll^arigle- dm^^ 

rr^urt: lead and lag aircraft as a function of filter setting, v 



NAVTRAEQU IPCEN IH-297/AFHRL-TR-78-45 



UJ 

oe 

o 



0.2 



0.1 





1 ^ 














5> 
























• 








> Lorciiu 


[>INAL. 








5_ ^ 


? - 




\m 


. Lateral 


t— 








1 



l/H 1/2 3/U 1 2. 
Filter Break Frequency ln Hz 



Figure 12. Jfarlance of the pilots* longitudinal and lateralra>t1s 
moveinents of the control stick as a function of f liter 
setting. 
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Bandwidth of the pilots* longitudinal' and lateral -axis 
niovenents of- the control stick as a function of filter 
setting. . 
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Figure 14. Average* position of left and right throttles as a 
function of filter setting. 
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Variance of the position of the left and right throt 
as a function of filter setting. * 
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Figure 16. VarlariS^ of the differences of" yaw ang1^ of the lead and 
lag a1%raft as a function of filter settlpg'. 
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Figure 17. Variance of the position of the rudder pedals as a function 
* of filter setting. 
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Figure 18. Average lateral position of, the control stick as a function 



of filter setting. 




More finely in the odds .and end s^ategory^e^ ^ 
z-axis position and its variance ^hown^in F gures ^^J^ ^ ^^.^^er set- 
pilots" tended to the-ASPT simu ation a im^^ ^ the, fH ter set- 
tings, and this height along^h Its vam^^^^ ^^^^^^ 
ting was increased to ' Again, nx^^ie t^ny because oT 
The z-axis information to the CIG^display systOT was tii^ ^ Undoubtedly 

Wiaritie^the si'""^^^i°^°JJ°^S;°^S;^z!ai?s this:.caspect 
this effect on ^ measure of position- along tne- z axis re 

of our simulations ' - — 

Finally. Figure .21 P-^-"^*-!,^/,;^,?^^^^^ 
difference of PO^vtion of the two airc^^^^ ^.^^ why this 

« iu^r^href^:c*tihrt^^f^^^^^^^^^ 

thrust used by the pilots. . ' \ 

RATING MEASURES, th. subjective ratings xolU^^^^ 

^ they consistently differed with changes of the ability of 

. ratings of both the flutter m J^Jy^l!fL^^^ and after, the 

the station fit Jhe one-way an^^ While the ratings 

ratings were converted^ fSfne^oint scale where high 

, of noise in the Cie o^sfj^ "Jlf'^i °„ numbers a jittery one, the 

numbers represented a stable display and ;°^,^";^;^%he ^nost controllable 

-4?is^atitriin^rT-hi si^^o "t^^^^^^ 
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Figure 19. 
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Filter Break Frequency in Hz 

Average difference of z^axls position of the lead. and 
lag aircraft as a function of filter setting. 
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Figure 20. 



in 3/4 1 2- 
Filter Break Frequency in Hz 
Variance of the z-axis difference of position of the 
lead and lag aircraft as/i fanctlon of filter setting. 
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Figure 21. Bandwidth of the x-axIs difference of position' of 4he lead 
and Ug aircraft as a function of filter setting. 



where the filter was set to a break frequency of 1/4 or 1/2 -Hz. Particular 
events during those trials seoned to be selected for the rating and the result 
was that the ratings for these low- frequency settings of th6 filters were 
quite variable. The pilots pilots agreed that those Settings were not desir- 
able, but they could not consistently extract from the Behav^jr of the display 
just what it was that they did not like. Occasionally a gust would sum with 
control input and the condition was judged too responsive, /and just as fre-. 
quently, the same filter setting was judged too sluggish. /So to remove this 
ambiguity, the ratings of flight controllability were "folded" to become a 
one-to-five scale (ratings of six, seven» eight, and nine became ratings of , 
four, three, two and one). Now high numbers on the scale represent control 
that was easy and low numbers represent difficult control, regardless of the 
reason." ' 

The results of the analyses performed on the rating data are presented- in 
Table B-27 of Appendix B and are depicted in Figure 22. The pilots judged the 
flights to be significantly less well controlled under the 1/4 Hz setting, 
V 3 • . . . . ^ — 1,,.. — i — Ti-j^ jjy^ perhaps 

lay jitter show 
condition felt' 

to be the worst case. Although the relative scaling of th<^two ratings is 
immaterial, we can see that a mid-range of filter settings is^.preferable- to 
either a low-frequency setting or a no-filtering condition. Their -ratings 
of system controllability par-al lei objective measures of flight control. — - 
i.e., as the pilots changed their control activity so that the variance or \ 
bandwidth of a -measure approached its value under the no-fi-l tenng condition, 
the controllability of the simulation was felt to increase, while at the same 
time they judged the jitter of the computer -generated visual image to become 
more and more annoying with the unfiltered image judged a's containing thejnost 
noise. 

<d 35 ^_ , 




NAVTRAEQUIPCEN IH-297/AFH^-TR-78-4,6 



8 
7 



5 



3 



L ' t ' 




« lillll 














) } 




[—-J 






/ 

/ 
















/ 

/ 
/ 










1 « 






/ . 
/ , 
















R-IGKT 










1 1 V" 
















1 1* 

















o 

o 



2 ^ 



Figure 22. 



yii 1/2 3/i» 1 2 • 

Filter Break Frequency in Hz 

Pilot ratings of flight control and CIG system 
noise as a function of filter setting. 



So that the main finding of this study can be displayed more clearly, we 
have plotted in Figure 23 the normalized ratings of the noisiness of the 
visual image and the average of t^e normalized pitch and roll errors "both 
as^ function of the break frequency of the display. signal fibers. Both sets 
of data are expressed as z-scores to indicate where a particular measure was 
Love or below its experimental average of zero. Here we can see that as the- 
break freouency of the filters was raised, aircraft control becameftnore and 
ac^S?ate in?il a "best" setting of 1 Hz was reached while at the same^ 
^J^. the ratings of the visual display were not drastically reduced until a 
setting above 1 Hz was. reached. Clearly a relatively "Safe" setting for the 
filteri can be defined where the changes to the CIG system's inputs will not 
degrade piloting control and pilots will feel the' display h^s acceptable 
.stability. Thfs is the shaded range in the figure. 

We feel that some factors of flight simulations should determine where the 
break point of dilpTIy filters should be. Should this sort of delay compensa- 
te bCised for a sikilation of air-to-air combat using high performance air- 
craft a setting near the upper end of the safe range would be preferred, and 
<cS^;^ly! a tisk that requires the' display of only low rates of angular - 
a?2^t^tion may well benefit by 6sing a low frequency •setting. Along with 
th?Wt of flying tksk, the ty^e of aircraft simulated v^ill detei^nine the 
filtersettingf al obviously, a simulation of an aircraft that can have high 
fJ-eqSency comfSnents in its responses should have .those components reach a . 
vif2al display! The trade that filtering al ows is one of preference for .a^ 
oarticular amount of display stability vs. flying performance.. For the T-37 
KJ^St Lnhe simulation of fonnation flight used for this study, there 
lleaH/v^s a rlnle of settings that-al lowed the degree of flight control 
noma ly found in the ASPT and that also removed .most of ^^e annoying jitter, 
"Hhe CIG system's image.- From these two experiments, we suggest that this 
range is from 3/4^ to 1 Hz. 

■ ■ ■ ■ 36 : * •. /■ • " 
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Filter Break pREoygNcy -in Hz . . . 

Figure 23. Average^ fl 1 ght control and.ofSlnlon of , the computer- . 

^ generated Image as a function of filter setting. The v 
^ measure of flight control Is the average of the variances 
of the differences of pitch and roll angle, -and both 
sets of data are nomallzed. 
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, , , SECTION IV > , ; _ . 

* CONCLUSIONS • ' V 

■ , -J .- . 

a.. The predict-.then-fiVter scheme implemented on the ASPT is useful for 
delay compensation in operational flight simulators that have significant 
traKport delays, in the Qperatibn of their. CIG visual systems. 

' b. The usefulness of the scheme is .|§at a filter setting can be chosen 
that reduces the annoying high frequenci^rtjponents of the signals sent to 
the visual display processor without: af'^.cl^mg flying control performance, 
and that ft can easily be 'imiDleraented as either hardware or computer software.^ 

. c. The scheme affects piloting coYitrol only when useful "low frequency 
information (belbw.1/2 Hz) was removed from the CIG display. Tasks other than 
fdrraatfon^ flight may require" higher frequency information, but many of the fly 
ing tasks for which CIG displays are used probably iiave. requirements similar 
ta those of flying formation. - 

• d. Tor a given, amount of lead. It would be relatively easy to tailor this 
scheme for a particular, task. or device by manipulating a single parameter - 
the break frequency of the display filter. , 

e. For most of the parameters of aircraft control and pilot input that 
we observed, the variance was the measure most sensitive' to changes of the 
visual display. In Experiment II, the bandwidth measure also was sensitive 
to our manipulations and seemed to correlate with the variance — in that 
changes of bandwidth were probably the activity reflected as significant 
differOTces of variance; 
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' V~ ' FORWATION: "flight GRADING CRITERIA . . : 

- - TABLE As-W 12-POINT SCALEiJSED FOR RATING FLIGHT CONIBOL IN EXPERIMENT- l \ 

• ...-HXCaLENf ■ ■ 'v . . ' 

' T . -Exceirent i si characterized by exceVtionaTly snwoth cpntroT^ and small d^^^^ 
ttons from the desired position. Excellent position is maintained within .^-^ 
.; deviations as follows: 

a. Fore^Aft (longitudinal): + 2 ft. 

b. Side-side (lateral): f rom 1 ft closer in (tighter) to 3 ft further _ 

.'/^ ■■.out., ■ ' .,' . i ^. _ ■■ ■ / ■. ^ . '.V---. - 

c. Vertical: from less than 1 ft-high to not more than 3 ft low. 

2. Good.^J3^od is characterized by smooth control, with larger deviations and 
, longer time out of position. ^Deviations must range within: . 

•• . a. Fore-aft {Tongitudihal) + 3 ft. ; . v • 

>* b.' Side-side (lateral) from 1 ft closer in (tighter) to 5^ f^ 

^; c Vertical: frbm^ft high to; 4 ft low. - / ' • 

■ 3 - FaiV^^^^ characterized t>y rough qontrol with Targe devi a tlonSi al- / 

• most always out of position. Deviations range within: v ; • ; : 

. r "; : a. Fqre-aft (longitudinal > 

• b. ' SideTSide eiateral) from 2 Vt closer in (tighter) to 8 ft further out. 

' / ■ . '■ ■ : '.■ n "-- ' ■ ■ ' • ■■■■ 

• c. Vertical: from 4 ft high to 6 ft;low. ■ V - 

4 Unsatisfactory. Unsatisfactory is charactefiked by the inability to main- 
.^tin even fair position. Aircraft control is rough. 

^ TABLE A-2. DESCRIPTION OF 12-POINT SCALE VALUES' OF TABLE A- 1 USED FOR 

• EXPERIMENT I . ^ - < : 

EXAMPLE GRADES - ; .. . •. .' . \ . - 

12 Perfect pdsiti on maintained, control use smooth, accurate. . 

iV Only small deviations seen. Control use smooth. Errors quickly corrected. 

TO Deviated from desired only within the excellent area-,, however,^ did not 
remain "on" desired position, but passed through it.. ^ 

■ . 9 Renalned tightly within thf"good">rea.\ control use^ 

• .excellent.-: -.- v-- • ■ 

ERIC V"-V.: :-'--:''-- -^:^ . V"^ 44'' ■ 
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TABLE_A-2: DESCRIPTION OF la-POItiT SCAtE VALUES OF TABLE A-T USED FOR . ' 
EXPERIMENT I (ContM) " . 

8 A solid good.. Normal use of. controls. Was in ppsitiofi most of the. time. 

7 Stayed~.1n good area, but control .use was.- a little rough. Drifted con- 
stantly out of position. V 

' ■ * 

6 Nearly a "goodi" but deviations somewhat too large. Correction ti.Tie_ too 
slow, and control . use -too rough, :. .„ y - ■ , " 

5 Kept aircraft' in fair -position but" was constantly jockeying the controls; 
- ; Almost .always correcting errors. Somewhat behind the ^ircr aft... 

4: Barely stayed.in the basic fomation-flight area. .'Aircraft. control poor. 
Almost unsafe^: . ' « • 

3 Able to move the aircraft into the '^air" area, but unable to keep it 
there. Constantly i'behin^" the other aircraft. 

2 ' Did not crash or otherwise jeopardize life, bat could not, maneuver, into: ; 
.position. . 

. 1- Crashed, passed under, over, or fell out of range. 

, ' TABLE A-3.. DESCRIPTION OF CIG\RATING SCALE OF, EXPERIMENT . I 
^ : . . ADDITIONAL RATiNG INFORMATION • - 



■-5 



-" We expect that some of the computer software changes -that we will make . 
between .trials will affect the characteristics. of the CIG visual displ ay,, and 
therefor-e after each^tr.ial , we would like you to rank the. display's "goodness 
or^Ssef ul ness for. f oraation f 1 i.ght. Thi s wi 1 1 be i n addi ti on to the numeri cal; 
score you will give -the flight, and in order to avoid confusion, we would like 
you to use a letter scale where A = good, B = average, and C = poor, and where 
pluses and minuses are allowed. The ratings can thus go from A+ to C-, and 
for-decisions like B- .vs C+, you. will have to do the best you can. 

' . ■ - . ■ - . ' ■ ^ 

These letter scores can be entered on the flight score sheet after the . • 
numerical score for a given trial, and f he. first entry might look Inke: . 
~^ — T .6,..C+-.- ■ ...v; -v.,:. . v,;' ■ 
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TABtfA4. .- SCORE SHEET ^SED BY INSTRUCTOR PILOTS IN EXPERIMENT I 

p ordBS . . *1 . • 'name'' ^ . : ■■ ■ ' ' ■ ■ 



o 





1 




2 




3 




4 




5" 




6 




7 




8 




9 




lo- 




ll 




12 




13 




14 




15. 




16 




17 




18 



DATE 



> . 


- ^ GRADING: 


. U + 


- P.+ 


- fi + 


- E + 


r- , 




1 ^ 3 


4 5 6 


7 


16 ^^ ^^ 



OVER, 4, 


4 


2 


1 HIGH ^ 


OVER 6 


6 . 


> 

4 


3 LOW. : 


OVER 5 


5 


3 


2 FORWARD^ 


OVER 5 


. .5; -''' 


. 3 


2 BACK . 


'OVER 2 


2 


1 


1 LEFT . . 


OVER 8 


r8 ' ■ 


■ : 5 ^ 


- ' 3 RIGHT 



TABLE A-5. RATING 




II 



nmiPJION OF AIRCRAFT^ . ' : JUDGMEKT OF SWIATOR 

Far too sensitive and difficult to control. Responsive + 

Aircraft is sensitiv6^nd .too''>esponsi Responsive 

Only a bit too sensitij/e for good control , ; Responsive - 

tontrbllable, butsenslti^^ : , ' , , • Controllahle;! 

■perfectly ControTlable - Responds as it staild. Cotitwllable 

.Controllable but' slugsisti., . Controllable- 



Aircraft response is only a bit slow for 
good control. 

Response is slow and -sluggish. 

Aircraft is too sluggish and responds too 
Slowly. 



•Sluggish + 
Sluggish 



Sluggish 



DifficQlf ■ 
Control 



Controllable 



Difficult 

■A 

to - : 

Control .. 



TABLE I\-6. -RATING SCALE FOR 




RATING 
9 

7 



. DESCRIPTIOR OF JITTER IN DISPLAY 

No flutter or jitter 
' Barely detectable jitter \ 
■ Jitterls noticeable but not annoying, 



JUDGMENT OF DISPLAY 

, 1 ■ • , . 

Satisfactory+r . - 
Satisfactory: 
Satisfactory - 



01 



6 

5 
4 



Easily noticeable jitter, but only barely 
annoying 

Jitter is noticeable and mildly annoying 
^loticeable and annoying jitter • 



Usable + 

Usable 
Usable - 



\ 
2 
1 



Almost usable, but jitter is annoying 
.' Barely usable, very annoying jitter 
' Unusable - Jitter is far too annoying 



Poor + 
Poor 
. Poor - 
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APPEHPIX B 

ANALYSIS OF VARIANCE TAa.ES OF EXPERIMENTS I AND II 



and II. 
level 



These tables report the analyses of variance of Exper:iments 
In them, the exact probabil ity of^^^-ratios significant at the p^. 05 1 eve 
or qreater are given along with n^/- the proportion of the total sum of 
squares attHbutable to each signi-ficant. effect. The analyses -for^a given 
measure are grouped together — those of the average val ue and variane^, for. 
the- data of Experirent r and of the average<rvalue, variance, and bandwidth . 
for Experiment II. Occasionally /rather large numbers were encountered as ■ 
sums of squares antf .to conserve space, these were expressed in exponential or 
scientific notation. The value/to four places is expressed as a decimal and 
the number following the E is an exponent of ten. For example, 0.l.i34t/, 

MJuld repWsent 0.1234 X 10^ or 



TABLE B-1. 



ANALYSIS OF /THE AVERAGE VALUE (A) AND VARIANCE (B) OF THE^ 
X-AXIS DIFFERENCE OF POSITION: OF THE LEAD AND LAG AIRCRAFT 



(A) 

SOURCE 

Blocks 

Treatments 

A 

B 

C 

'AxB 
AxC . 
BxC 
AxBxC 
Residual 
Total . 

(B)V • 

Blocks 

Treatments 

A 

B 

:C ■ ■ 
AxB 
AxC 
BxC 
AxBxC 
Residual 
-Total • 



SUM OF SQUARES ; df 

'169294.60 

7205487.50. 

-255036.60 ^ 
659077-. 61 
191216.69 ' ■' 

1233427.90 
- 532276.81 

1638471^70 

2695180,30. 
21389720.00 



.12936E+11 
,221 96E+12 
.78885E+10 
.52143E+11 
.17582E+11 
.40799E*11 
.17651E+10 
.6^820E+11 
.39965E+n 
.65p47E+12 
.SS537E+10 



df 


MEAN SQUARE 


F-RATIO 


3 


56431.53 


0,42 


53 


135952.59. ^ 


-1.01 


2 


12791S.3Q 


0.96 


- ■ 5 


131815.52 


0.98- 


2 


^ ■ 95608.34 


0.71 


10 


123342.79 


0.92 


4 


133069.20 


0,99 


TO, 


163847,17 


1.22 


20 


134759.02 


1.00 


159 


,134526.54 











.744 



3 


,43122E+10 


1,05- 


53 


,41880E+10 


1,02 


2 = 


.39442E+T0 


0,95 


. ■ 5 ■■ 


.10428E+n 


2,55 


■ - 2 


.87914E+10 


2.1.5 


10 


.40799E+10 


0.99 


'4- 


,44129E+9 


0.11 


10 


,61820E+10 • 


1.51 


20 


,T9982E+ia 


,0U9 


159 


,40910E+10 











.0295 .058 



.735 
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TABLE B-2. 
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ANALYSIS OF THE AVERAGE VALU£ (A) AND VARIANCE (B) OrTHr 
Y-AXIS DIFFERENCE OF POSITION OF THE LEAD AND. LAG AIRCRAFT 



(A) 

SOURCE 

Bl octcs 

'Treatments 

A- 

'B • 
C 

AxB 

AxC 

BxC 

AxBxC 

Residual 

Total 



SUM OF SQU/^RES df MEAN SQUARE T-RATIO 



1624517.20 : 3 54^505.73 

9734820:40 ' 53 183675.86 

437389,08 . 2 " 218694.54 

1657612,60 5 331522.53 

932172,32 ' 2 466086.16 

3687199,70 10- '.368719.97 

1375824.70 4 343956,18 

3264811.30 .10 ' 326481.13 

■■6378910.40 ' 20 , 318990.52 

526359 20.00 1 59 331043.52 

71595257.0 FIT . 



1.64 
0.55 
0.66 
1.00 
1.41 
:1.11 

0.99 
0.96 



.731 



(B) 






Blocks 


.32476E+9 


3 


Treatments 


.11274E+12 


53 


A 


,31673E+10 


2 


B 


,13551E+11 


5 


C 


,19453E+10 


2 


AxB 


.28850E+n 


10 


AxC 


.10965E+11 


4 


BxC 


.23679E+11 


' 10 


AxBxC 


.30584E+T1 


. 20 


Residual 


.36109E+12 


159 


Total 


.47709E+T2 





',10825 E+9 0.47 
.21272E+10 , 0.93 

.15836E+10 0,70 

..27102E+10 1.1^ 

.97268E+9 -0.43 

.28850EfrO 1.27 

.27413F+10 1.20 

.23679E+10.- 1.04 

.15292E+10 0.67 
.22710E+10 



.757 



TABLE B-3. ANALYSIS OF THE AVERAGE VALUE (A) AND VARIANCE (B) OF JH^ 
Z-AXIS difference; OF POSITION OF THE LEAD AND LAG AIRCRAFT 



(A) 

SOURCE 

Bloc:ks 
Treatments 
A- • 

■B 

C - ■■ • 
AxB .. 
AxC '. 
BxC 
AxBxC 
Residual . 
Total 



SUM OF SQUARES df MEAN SQUARE - ' F-jAnO; 



3035.96 


3 


1011.99 


9298,42 \ 


53 


175.44 


669.17 


.' ' '2 - 


334.59 


728.01 


5 


145.60 


/ 206.71 


2 


103.36 


2106.55 


10 


• 210.65 


"*1157.10 


■> - 4 


289.28 


1632.07 


10 


"163.21 


2798.80 


'=-^20 


— 'T39.94 


,27807.77 


159 


174.89' 


40142.15 


YTT 





5.79 

liOO 

1.91 

0.S3 

0.59 

1.20 

1.65 

0.93 

OiSO 



;0012 .076 



.693 
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TABLE B-3. 



(B). 

SOURCE 

■ — — ^ . 

Blocks 

Treatments 

A 

B 

C 

AxB 

AxC 

BxC 

AxBxC 

Residual 

Total 
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ANALYSIS OF THE AVERAGE VALUE (A) AND VARIANC.MB)^6r THE Z^^^^^ 
DIFFERENCE OF POSITION -OF THE LEAD AND LAG AIRCRAFT (ContM) . 



-J 



SUW OF -SQUARES " df 

".3458TE+10 
.2935eE+n 
.TQ544E+10 
.462425E+10 
^30TE+10 
^g328E+10 
^7469E+10 
,.81067E+10 . 
.13161E+11 ' 
/IT532E+12 
7r55T3E+Tr. 



QT 


MP&N ^nilARE! 








S5389E+9 


2 


.52723E+9 


5 


• .92485E+9 


2 


.T3650E+10 


10 


.69328E+9 


4 


.68675E+9 


10 . 


.81067E+9 


^0 


.65804E+9 


159 


.72527E+9 r 







f-rATIO" p 

1.59; '■■ ■ 
0.76 
0.73 
.1.28 
1.88 
0.96 

0.95 . 

1.12. 

0.91 



.729 



Tani P R A ANALYSIS OF THE AVERAGE VALUE (A) AND 'VARIANCE (B) OF THE. 
TABLE B-4. g^ALYSg^OF^THE^MVtKMUt^ LAG AIRCRAFT 



(A) 

SOURCE 

Blocks 

Treatments 

A 

B 

C - ' 

AxB 

AxC 

BxC 

AxBxC 

Residual 

Total 

(B) 

Blocks 
Treatments 

B ■ 
AxB 

AxC • 
BxC ~ 
> AxBxC 
Residual 
Total 



SUM OF SQUARES df MEAN SQUARE F^RATIO 



93.99 
636.12 
8.29 
35.50 
80.72 
137.90 
133.00 ' 
-100^57 
140.13 
1673.88 



193812.92 
1199290.78 
. 42240.93 
55286.83 
215488v60 
215077.45 
63066.01 
162225.06 
435904.88 
2893975.20 
42S7fl78.80 



3 


. 31.33 


53 


12.00 


2 


4.14 


. 5 ' 


7.10 


2 


40.36 


10 


13.79 


4 


33.25 


TO 


10.06 


20 


7.01 


159- 


10.53 





3 


64604.31 


.53 ;■■ 


22628.13 


■ ■ ■ 2 . " 


21120.47 ' 


5 


13057.37 , 


2 


1 07744^30 


10 


21507^75 


.4 


15766.50 


-10 


16222.61. 


"20 


21795.24 


^159 


18201.10 








• 48 . 



2.98 
1 .14 
0.39 
0.67 
3.83 
1,31 
3.16 
0.96 
0.67 



A, 

: 3.55 
1.24 
1.16 
0.72" 

- 5.92 
1.18 
0.87 
0.89 
1.20 



.0325 .039 

.0236 .034 

.0156 .055. 

.696 

J)157 .045 

.0031 .050 

.. ".675 
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TABLE B-5. 



NAVTRAEQUIPCe^ IH.297/AFHRL-TR-78-46 

ANALYSIS OF THE -AVERAGE^VALUE (A) AND VARIANCE (SrOF THE 
DIFFERENCE OF PITCH ANGLE OF THE LEAD AND LAG AIRCRAFT 



(A) . , 

SOURCE ■ : 

Blocks 

Treatments 

A 

B . 
C 

AxB~ 

AxC 

-BxC' 

AxBxC 

Residual 

Total 

(B) r 

Blocks 
■Treatments 

-'Aa,'- "\, 
B ' 

- C- - V 
AxB 
AxC 
BxC 
AxBxC 
Residual 
Total : . 



SUM- OF SQUARES . df - ' MEAN SQUARE F-RATIO 



-0.84 


3 


13.60 


53 


0.42 


2 


1 .13 


5 


0,29 


2 


2.91 


-10 


1.54 


4 


3.33 


10 


3;98 


20 


39.13 . 


159 


K3.56 





739.28 


.3 


1884.06 


: 53 


62.02 - 


• \Z 


294.63 




641.73 . 


. - r2 


269.75 


'10 -r- 


« 39.42 


4 


216.05 


10 


360.45 


. '20 


3054.71- 


159 







0.28' 

0.26 

0^21 

0.23 

0.15 

0.29 

0.38 

033 

0.20 

0.25 



246.43 
35.55 
31.01 . 
58.93 

320.8^ 
26.97 
9.80 
21 .'61 
18.02 
19.21 



1.14 
1.04 
0.85 
0.92 
0.59 
1.18 
1.56 
1 .35 
0.81 



.731 









12.83 


^.0000 


.130 


r.85- 


.0021 


.332 


1.61 






3.07 


.0114 


■'.052 


16.70 


.0000 


.113 


1.40 






- 0.51 






1.12 






0.94 







.538 



■i 



TARr F R-6 ANALYSIS OF THE AVERAGE VALUE (A) AND .VARIANCE (B^OF THE 
TABLE B-6. . g^^^^^f qF YAW ANGLE OF THE LEAD AND D^G AIRCRAFT 



- (A) 



SOURCE SUM OF SQUARES df MEAN SQUARE f4iATI0 



» 

.2 



Blocks 

Treatments 

A 

B 

.;C ■ - ■ ; 

AxB ^ • 
AxC • 
BJcC) 
-AxBxC 
Residual . 
Total 



. 203.00 3 

17404.79 . 53 

206.74 2 

1666.96 5 

920.13 :2 

3464.58 10. 

1692.22 - 4 

"3123.97 10 

6330..19 „ 20 

.44424.8^ 159 



67.67 
328.39 
103^7 
333.39 
460.07 
346.46 
423.05 
312.40 
316.51 
279.40 



0.24 
1.18 
0.37 
1.19 
1.65 
1.24 
1 .51 
1_.12- 

i.ia 



.716 



ERIC 



49 



5P 



mVTRAEQUIPCEN I«-OT/AFHRL-TR-78^^ 

ANALYSIS OF THE AVERAGE VALUE (A) AND VARIANCE (B) OF THE • 
Si^ERENCE OF YAW^S^ tIF THE L£^^ AND LAG AIRCRAFT .(ContMT 



(B) ■■■■ \ 

SOURCE 

Blocks 

Treatments 

A 

..c , „•• 

• AxB 
AxC 
BxC 
^AxBxC 

Y T6tal 



SUM OF SQUARES df MEAN SQUARE F^^TIO , 



.1849DE+8 3 
.28419E-t9^. . 53 

.29195E+8V 2 

^52E4e 5 

.18699E+8 2' 

.40DT3E+8 TO 

.n393E4e 4 

.42749EH:e 10 

..n998E^ 20 

^50866M. 159 



61634E+7 

53S20E+7 

1459r£-+8, 

44304 E+7 

93496E+7 

4001 4E+7 

28481 E+7 

42749E+7 

59993E+7 

3199TE+7 



1^92 
1.68 
4.56 
U38 
'2.92- 
1,25 
0,89 
U34 
1,87 



.0015 
.0118^ 



.034 
.027-. 



I 



.148 
.627 



TABLE B-7. 



ANALYSIS'OF THE AVERAGE VALUE (A) AND VARIANCE (B) OF THE 
^TERAL MOVEMENTS OF THE CONTROL STICK, - ■ - - 



(A) 

SOURCE 

Blocks 

Treatments 

A 

8. ^ . 
C 

AxB • 

AxC 

BxC 

AxBxC 

Residual 

Total 



SUM OF SQUARES df MEAN SQUARE T-RATIO 



0.038 


3 


0.145 


. .53 


0.009 


2 


O.016 


. 5 


0.059 ■ 


2 


0.016 ■ 


10 


O.008 


4 


0.006 . 


TO 


0.031 . 


20 


0.312 


159 


0.494 





0.013 " 

0.003 

0.004 

0.003 

0,029 

0.002 

0.002 . 

0.081/ 

0.002 

0.002 



6.38 
1.36 
2,16 
1.62 
15.03 
0,79 
1,07 
0.31 
0.80 



.0007 .077 • 



.0000 /.1 19 



. ,532 







Blocks 


^^-13.12 


TreaUnents 


• 58.01 ^ . 


A 


3.20 . 


B 


12.30 




'26.48 


AxB 


4.73 


AxC 


0.62 ' 


BxC 


5.70 


AxBxC 


■ 4.99 • 


Residual 


87.01 


Total 


158.14 



r 

. 3 
53 
2 
5 
2 
10 
4 
10 
20 
159 



,4.37 
1.09 
1.60 
2.46 
13.24 
0.47 
0.15 
0.57 
0.25 
0.55 



7.99. 
2,00 
-2.93 
. 4.49' 
24.19 
0.86" 
0.28 
1.04 
0.46 



.0002 
.0007 

.0010 

;0000 



:.083 
.367 

.078 
.167 



.550 



50 



TABLE B-8. 



NAVTRAEQUIPCEN IH-297/AFHRL-TR-78-46 . 

ANALYSIS OF THE AVERAGE VALUE (A) " AND ^VARIANCE (B) OF 
THE LONGITUDINAL MOVEMENTS OF THE CONTROL STICK 



(A) 

SOURCE ' 

Blocks 

Treatments 

A 

B 

C 

AxB 
AxC 
BxC 
AxBxC 
ResTdual - 
.Total 



SUM OF SQUARES df MEAN SQUARE F-RATIO Jgg. 



0.0024 

0.3740 

0.0CS2 

0.0367 

0.0003 

0.0852 

0.0173 

0.0650 

0.1685 

li6046 

1 .9825 



3 


0.0008 ^ 


0.08 


53 


0.0070 


0.70 


2 


0.0016 • 


0.16 


5 . 


0.0073 


. 0^73 


2 


0.0001 
'0.0085 


" 0.01 


10 


0.84 


■ 4 . 


'0.0043 • 


-0.43 


10 


0.0065 


0.64 


20 


0.0084 . 


0.83 


159 


0.0101 






•4 





.809 



(B) - 

Blocks 

Treatments 

A* 

B 

C 

AxB 

AxC 

BxC ' 

AxBxC 

Residual 

Total 



7.35 
14,61 
0.48 
2.40 
7.91 
1.20 
0.37- 
0.63 
1.62 
26.52 
70S" 



(A) 

SOURCE ■ . 

Blocks 

Treatments 

A 

B 

C : 

AxB 

AxC 

BxC 

AxBxC 

Residual 

Total 



3 
53 
2 
5 
2 

-10 
4 
10 
/ 20 
159 
2T5" 



3.45 
0.28 
0.24 
0.48 
3.96 
0.12 
0.09 
0.06 
0.08 
0.17 



. 14.68 
1 .65 
1.43 
2.88 

23.72 
0.72 

- 0.56 
0.38 

' 0.48 



TABLE B-9. 



ANALYSIS OF THE AVERAGE VALUE (A)< 
THE POSITION OF THE RUDDER PEDALS 



AND 



.0000 
.0094; 

'.0161' 
.0000 



.152 
.301 

i050 
.163 



.-547 



ARIANCE 

V - 
■n. 



(B) ^ OF 



SUM OF SQUARES df ' MEAN SQUAt^E . F-RATIO . 



0.255 
0.260 
O.OIS 
0.010 
0.116 
0.027 
0.009 
0.041 
0.042 
0.476 



3 


0.085 ' 


^ 53 


0.005 


2 ' 


0.007 


5 . 


0.002 


2 


0.058. 


10 


0.003 


4 . 


0.002 


10 


0,004: 


20 


0.002 


159 


0 .003 


^ 





28.^^^^ 
1.63 
2.48 
0.66 

19.31 
0.91 
0.78 
1.38 
.0.69. 



.0000 
.0112 



.258 
.263 



.0000 .117 



.481 



ERIC 



51 



54 



NAVTRAEQUIPCEN IK«297/AFHRL-TR-78-46 



TABLE B-9. 



ANALYSIS OF THE AVERAGE VALUE (A) AND VARIANCE (B) OF 
THE POSITION OF THE;1UI006R PEDALS (Cont'd) 





• 

- 










SQUKCc 


CffM AC CAITADCC 


Q r 




F-RATin n • 


»1 


Blocks 


0»UUClD 


o 
o 








Tfteatraents 


O.OOoo 


CO 

oo 




.1 




A 


0*0001 


Z 


A AAAA 






B 




e 
o 


A nnm 


1.79 




C 7 r7 " 


^,00T6 " — 


. 2 


O.O008 


- n ;40 -.0001- 


—.089 


AxB 


0.0014 


10 


0.0001 


2.05 .0313 


.078 


AxC 


0.0000 


4 


0.0000 


0.09 




BxC 


0.0009 


10 


0.0001 


1.29 




AxBxC 


0,0020 


'20 


0.0001 


1 .48 


.606 


Residual 


0.0109 V 


159 


0,0001 




Tbtal 


0.0150 











TABLE B-10. 



ANALYSIS OF THE AVERAGE VALUE (A) AND VARIANCE (B) OF 
THE POSITION OF THE LEFT THROTTLE 



(A) 



-SOURCE 


SUM OF SQUARES 


df 


MEAN SQUARE 


F-RATIO 




Tl2 


Blocks 


2'95.07 


3 


- 98.37 


8.19 


.0001 


.091 


. Treatments 


1030.41 


53 


19.44 


-1.62 


.0118 


.319 


A 


1.85 


2 


0.93 


0.08 






B 


164.57* . 


. 5 


32.91 


. 2.74 


.0208 


.051 


C 


378.84 


2 


189.42 


15.78 


.0000 


.117 


AxB . 


93.86 


10 


9.39 


0.78 






AxC . < 


'66.09 


• 4 


^ 16.52 


1.38 






BxC 


127.26 


10 


12.73 • 


1.06 






AxBxC 


197.92 


20 


9.90 


0.82 






Residual 


1908.72 




' 12.00 






.590 


Total 














(B) 














Blocks 


1823318.00 


3 


607772.66 


22.19 


.0000 


.204'' 


■ Treatnjeqts 


2770875.00 


^ 53 • 


52280.66 


1.91 


.0014 


.310 


A 


25772.69 


2 


■12886.34 


0.47 






B 


203935.01 - 


^ 5 


40787 :00 


^ i:49 






C 


1165862.20 


2 


582931.12 


21.29 


,0000 


.130 


AxB 


273127.55 


10 


27312.76 


1.00 






AxC 


66815.78 


4 


■ 16703.95 


' 0.61 






.BxC 


403874.30 


10. 


40387.43 : 


1 .47 






AxBxC 


631487iS5 


• 20 


31574.38 


1.15 






Residual 


4364020.2G ' 


159 


27383.78 : 






.204 


Total 


-6J4S2U.80 • 













52 



NAVTRAEQU IPCEN , IH-??7/AFHRL-TR-78-46 



TABLE B-n. 



ANALYSIS OF THE AVERAGE VALUE (A) AND VARIANCE (B) OF 
THE POSITION OF THE RIGHT THROTTLE 



<A) 

SOURCE 

Blocks 

Treatments 

A 

6 

C 

y^xB 
AxC 

BxC i 
AxBxC 
Residual 
Total 



Blocks 

Treatments 

A 

B 

C 

AxB 

AxC ■ 

BxC 

AxBxC 

Residual 

Total 



SUM OF SQUARES . df MEAN SQUARE F-RATIO J£_ ^ 



555 .32 
909.42 
2.13 
133.50' 
334.15 
89.67 
58.80 
110.08 
181.10 
1676.76 
3141.51 



1681344.0 
2591764.0 

^593 9. C 
187854.0 
1111642.7 
251 CC. 7 
52261 .2 
350865.3 
592198.7 
3948198.7 
§2213Cio.i> 



-3- 
53 , 
2 
5 
- 2 
10 
A 
10 
20 
159, 



185.11- 

17.16 
. 1.06 

26.70 
167.07 
. 8.97 
-14.70 

11.01 
9.05 

10.55 



V7.55 
1.63 
0.10 
2.53 

15.84 
0.85 
1.39 
1.04 
0.86 



.0000— .1 77- 
.0110 .289 

.0300 .042 
.0000 .110 



.533 



3 


560448.0 


53 


48901.2 


2 


12969.7 


•5 


37570.8 


2 


555821.4 , 


10 


25100.2 f 


4 


15565.3 L 


10 


36086.5. 


20 


29609.9 


•59 


24831.4 


TTET ^ 





22.57 .0000 
1.97 ^0009 
0.52 • - 
1.51 

22.38 .0000 
1.01 
0.63 

• 1 .45 
1.19 V 



SOURCE 



TABLE B-12.^ ANALYSIS OF THE 
SUM OF SQUARES 



PILOT'S RATING OF HIS FLIOlrff 
df MEAr SQUARE - F-RATIO. _E__ 



Blocks, 
Treatmerlts 
A 
B 

C . ' 
AxB 
AxC 
BxC 

AxBxC ^ 
Resi dual • 
Total.- 



474.15 
479.83 
' 2$. 36 

53.11 
207.25 

59.86 
. 19.14 

43.81 

67.31 
647.35 
1601.33 



3 
.53 
2 
5 
2 
10 
- 4 
10 
20 
159 



158.05 
9.05 
14.68 
10.61 
.103.63 
. 5.99 
4.78 
; 4.38 
y 3.37 
4.07 



38.82 
2.22 
3.61 
-^.61 
25.45 
1 .47 
I.IS 
1.08 
0.83 



.0000 
.0002 
.0284 
.0264 
.0000 



.Z05 
.315 



.135 

f 



.480 



.296 
.299 
.018 
,033 
.12^ 



.404, 



TABLE B-13. 



SOURCE 

Blocks 

Treatments 

A 

B 

C 

AxB * 

AxC 

BxC 

AxBxC 

Residual 

Total 



NAVTRAEQUIPCEN IH-297/AFHRL.TR-78-46 

Analysis OF the pilot's rating of the cig display 

SUM OF SQUARES ' df MEAN SQUARE F-RATIO 



595.35 
140.58 
2.01 
7.36 
52.84 
8.05 
9.44 
30.21 
30.68 
305.40 
1041.33 



.3 
53 
2 
5 
2 
10 
4 
TO 
20 
159 



198.45 


■ 103,82 


2.65, 


1 .38 


■ i.-oo 


0.52 


1.47 


0.77 


26.42 


13.76 


0*80 


0.42 


2.36 


1.23 


— 3.02 


1.57 


1.53 


0.80 


1.92 





.0000 



.0000 



TABLE B-14. ANALYSIS OF THE OBSERVER'S RATINGS OF THE FLIGHTS 



SOURCE 


SUM OF SQUARES 


df 


Blocks- 


460.80 


3 


Treatments 


410.33 . 


53 


A 


30.33 


2 


B 


19.00 


• 5 


C 


176.78 


2 


AxB ■ 


23.67 


10 


AxC 


15.72 


4 


BxC 


38.06 


10 


AxBxC 


• • 1 06.78 - 


20 


Residual 


730.70 ' 


159 


Total 


. 1601 .ST V 





T53.60 
7.74 
15.17 
3.80 
"88.39 
2.37 
3.93 
3;81 

■ 5.34 
4.60 



33.42 
1.68 
3.30 
0.83 

19.23 
0.52 
0.86 
0.83 
1.16 



.0000: 

.0075 
.038 

.0000 




.05T 



.293 



.288 
.256 
.019 

.110 



;jio 



TABLE B-15. . A^LYSIS OF . THE 'OBSERVER ' S: RATINGS OF THE CIG DISPLAY 
jnilRTF . ■ SUM If SQUARES df : MEAN SQUARE - F-RATIO 



Blocks' * , 
Treatments 
•A- 
B 
C 

AxB ^ 

AxC 

BXC 

AxBxC 

Resi dual 

Total 



89.65 
164.83 
3.^5 
1.50 
35.11 
15.75 
8.55 
17.72 
82.94 
677.35 
931.53 



3 


29.88 \ 
3.11 ^ 


7f.02: 


.0004 


53 


0.73 




2 


1.63 ' 


0.38 ^ 




5 


0.30- 


^ 0.07 




2 


17.56 r 


4.T2 


.0000 


10 


1.58 


0.37 




4 


2.14 


0.50 




TO 


1.77 . 


0.42 




20 


4.15 


0.97 




159 


4.26 






TTS 









.96 



.038 



..727 



NAVTRAEQUIPCEN IH-297/AFHRL*TR-.78-46 

TABLE ^e. MS^^ ™| 
■ LAG AIRCRAFT 

SOURCE > SUM OF SQUARES df' MEAN SQUARE ' l^^RPJJD ' 

^ Average Value , 

BetV^eh GroUps " 0 72:593 -^^- --^ 

-Within Groups 0-338 Jg. O.oiy 

Total . 0.581 23 

Vari ance , . • ' 

Between Groups 0.722 , 5 ' 0.U4 1.283 

Within Groups ' 1-027 1 8 0.113 

Total CT?? 23^ 

Bandwidth 

« c 0 094 ' 3.869 .015 ,52 

- Between Groups . 0.469 5 oglj ■=>-<»°- 

- Within Groups 0^ • TB 0.024 , . 

: ..B.E B.17.' A^^F^T^^ 

/ LAG AIRCRAFT . . _ ^ . 

SOURCE " SUM OF SQUARES df MEAN SQUARE F^RAIIO ^ ^ 

Average Value \ - 

. Between Groups .124 5 , .025 _ 1.431 

- Within Groups 412; T| -^l^ . 
Total 23 

^ Variance ^ : ^ . - 

Between Groups .337 5 0.497 

Within Groups 2.4.44 18 .IJ/ . • ^ 

* Total- rTTST . 23^ 

Bandwidth J ^ > 

Between Groups .085 5 • §22 ' 

Within Groups . T| -O^Z _ 

Total .. ^ 



,2 



NAVTRAEQUIPCEN • IH-297/AFHRL-TR-78-46 



TABLE B-18. 



ANALYSES OF THE AVERAGE VALUE, VARIANCE, AND BANDWIDTH 
OF THE Z-AXIS DIFFERENCE OF POSITION OF THE LEAD AND U6 
AIRCRAFT 



SOURCE 
Average Value 



BetMeen Groups 0.729 

Wi thin Groups 0.793 

Total 1.52Z 

Variance 

Between Groups 1 .236 

Within Groups 1.502 

Total 2.738 

Bandytdth V 

BetweCT Groups 0.186 

Within Groups 0.393 

Total 0.579 



SUM OF SQUARES df MEAN SQUARE ' F-RATIO 



5 
18 
53" 



5 
IB 



5 
18 



0.146 
0.044 



0.247 
0.083 



0.037 
0.022 



3.310 



1.700 



.027 .48 



2.961 .039 .45 



TABLE B-19. 



ANALYSES OF THE AVERAGE VALUE, VARIANCE. AND BANDWIDTH 
OF THE DIFFERENCE OF ROLL ANGLE OF THE LEAD AND LAG 
AIRCRAFT 



SOURCE 
•Average Value 



Between Groups 0.753 
Withi n Groups , 1.285 
Total 2.08S 



SUM OF SQUARES df WEAN S(3UARE F-RATIO 



5 
18 



0.151 
U.071 



2.1 TO 



Variance 

Betweien Groups 3.145 

Within. Groups 0.811 

Total 3.956 



5 
18 
23" 



0i629 
0.045 



13.961 



.000 . 79 



Bandwidth > 

Between Groups 0.958 

Within Groups 0.309 

Total 1.267 



18 



0.192 
0.017 



/ 



11.171 



.000 . ^76 



56 



ERIC 
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NAVTRAEQU IPCEN IH-297/AFHRL-TR-78-4P 

TABLE B-20. ANALYSES OF THE AVERAGE VALUE. VARIANCE, AND BANDWIDTH 
OF THE DIFFERENCE OF PITCH ANGLE OF THE LEAD AND LAG . 

AIRCRAFT * 
SOURCE SUM OF SQUARES df MEAN SQUARE F-RATIO P _ ■ ti^ 

Average Value 

Between Groups" " 6^^^ 2.663 " ~ : 

Within -Groups 0.716 18 0.040 . . 

Total- T:^^ ^ . 

Vari ance 

Between Groups 3.783v 5 0.757 .66.842 .000 .95 

Within Groups 0.204 18 0.011 

Total 3.9S7 W 

Bandwidth 

Between Groups ~ 0.628 5 0.126 .37.550 .000 .91 

. Within Groups 0.060 18 . 0.003 

Total .688 

* 

TABLE B-21. ANALYSES OF THE AVERAGE VALUE. VARIANCE.^ AND BANDWIDTH 
iMBLt a ^j. DIFFERENCE OF YAW ANGLE OF THE LEAD AND LAG . 

AIRCRAFT • - ■ 

SOURCE ' SUM OF SQUARES df MEAN SQUARE , F-RATIO JoL- 



Averaqe .Value 



Between Groups 0.23(3^ . 5. 0.046 2.072 

Within Groups 0.398 18 0.022 . _ 

-Total "cr:^ 

Variance * . ! 

Between Groups 1 .585 . ' • . 5 ; 0.317 ; 5.190 .004 .59 

Within Groups 1.100 !§: 

Total, . -^^SS: ; > ^ ; . 
B andwidth " . 

Between Giroups 0.233 5 0.047 1 .S33 \ .,^.r 

Within Groups 0.456 18 0.025 ; 

Total . ^ * 



NAVTRAEQUTPCEN IH-297/AFHRL-TR-78-46 

TABLE B-22. A!«ALYSES OF THE A7ERASE VALUE. VARIANCE, AND BANDWIDTH 
OF THE LATERAL HGVEMENTS OF THE CONTROL STICK 

SOURCE SUM OF SQUARES df . MEAN SQUARE F-RATIO _g_ _ni_ 
Average Value 

Between Groups . 0.481 5 0.096 6.039 .002 .63 

Within Groups 0^287 1 8 0.016 

/Total 0»768 21 . ^ 

___Vajri:ance: tf. ' __ 



1 



Between Groups 9.316 5 1.863 76.475 .000 .96 . 

Within Groups 0.438 1 8 0.024 

Total 9.754 23 

Bandwi dth , . . ' - 

Between Groups 0.148 ' 5 0.030 4.337 .009 .55 

ffJthin Groups 0.122 1 8 0.007 

Total 0.270 2T 

TABLE B-23. ANALYSES OF THE AVERAGE VALUE. VARIANCE, AND BANDWIDTH 
OF THE LONGITUDINAL MOVEMENTS OF THE CONTROL STICK 

SOURCE " SUM OF SQUARES " df MEAN SQUARE . F-RATIO ^ 

Average Value 

Betweea Groups 0.000 5 O.OOO 0.226 

Within Groups 0.002 ^18 0.000 

-Total "JStpC? 2r 

Vari ance 

Between Groups 3.942 5 0.788 ,. 24.894 .000 ,87 

Within Groups 0.570 ' 18 , 0.032' 

Total. 4.512 2T ^ u 

Bandwidth " , • - ' ' ^ . , 

Between Groups 0.517 5 0.102 :3.516 .021 .49 

-Within -Groups: 0.530 18 -0.029 

Total TTWT 2T 



TABLE B-24. 



NAVTRAEQU IPCEN I H-2g7/AFHRL-TR-78-46 

ANALYSES OF THE AVERAGE VALUE, VARIANCE, AND BANDWIDTH OF 
THE POSITION OF THE RUDDER PEDALS 



SOURCE 
Average Value 



SUM OF SQUARES df MEAN, SQUARE F~RATIO 



J" 



Between Groups 0.234 
Within Groups — ; — 1.275 
Total 1.509 



5 

-18- 
?5" 



0.047 
0.071 



0.660 



.2 •• 



Variance 

Between Groups 1.365 

Within Groups 0.765 . 

Total 2.130 



5 
18 
US 



0.273 
0.043 



6.420 .002 .64 



Bandwidth 

Between Groups 
Within Groups 
Total 



TABLE B-25. 



0.095 
1.479 



5 
18 
23" 



- . at 



0.019 
0.082 



0.232 



ANALYSES OF THE AVERAGE VALUE, VARl)WicE, 
OF: THE POSITION OF THE LEFT THROTTLE . 



SOURCE 
Average Value 



Betweai Groups 0 . 003 
Within Groups 0.002 
Total * 0.005 



SUM OF SQUARES df MEAN SQUARE F-RATIO ^ 



5 
18 
IS 



0.0005 
0.0001 



3.530' .021 ^60 



Variance 

^ Between Groups 1.145 

Within Groups . 1.209 

Total. 2.354 



, 5 
18 



0.229 
0.067 



3.408 .024 . :.49 



Bandwidth 

Between Groups , ' 0.540' 
Within Groups 1 .185 
Total, - . 1.725. 



5 
18 



0.108 
0.066 



-1.641 



. TABLE B-26. 



NAVTRAEQUIPCEN IH-297)'AFHRL-TR-7e-46 

ANALYSES OF THE AVERAGE^ VALUE, VARIANCE, AND BANDWIDTH 
OF THE POSITION OF THE RIGHT THROTTLE 



SOURCE 
Average Value 



Between Groups 0.002 
Within Groups O.TXB 
Total 0.005 



SUM OF SQUARES df MEAN SQUARE F-RATIO 



5 
18 
23* 



0.000. 
0.000 



-3.035 ■ .037 ■ .40 



Vari ance 



Between"^ Groups 1 . 1 84 
Within Groups . 1.220 
Total 2.404 



5 
18 
23- 



0.237 
0.067 



3.493 .022 .49 



Bandwl dth 



Between Groups 0 .3 98 
Within Groups 1.447 
Total TTSZTS" 



- 5 
18 



0.080 
0.080 



0.991 



TABLE B-27. ANALYSES- OF THE PILOTS' RATINGS OF THE CIG DISPLAY AND 
OF THE FLIGHTS^-' ^ 



SOURCE ^ 
CIG Display 



SUM OF SQUARES df " MEAN SQUARE F-RATIO ' 



Between,^roups 15.64 
Within Groups T.34 
Total 16.98 



5 
18 
IT 



3.1 28 
0.074 



42.02 



.000 .92 



Flights 

Between Groups 5.05 

Within Groups 2.16 

Tdtal 7.21 



5 

18 



T.OlO 
0.120 



8.41 



.000 .70 



